-- Logs begin at Tue 2021-11-16 18:21:13 UTC, end at Tue 2021-11-16 19:23:06 UTC. -- Nov 16 18:52:42.035067 dv-cinder-667108-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 16 18:52:42.043329 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 18:52:42 2021] *** Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: nodename: dv-cinder-667108-35-iscsi Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: machine: x86_64 Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: clock source: unix Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: pcre jit disabled Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: detected number of CPU cores: 4 Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: current working directory: / Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: detected binary path: /usr/bin/uwsgi-core Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: your processes number limit is 47680 Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: your memory page size is 4096 bytes Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: detected max file descriptor number: 2048 Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: lock engine: pthread robust mutexes Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: thunder lock: enabled Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 16 18:52:42.046244 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 18:52:42.090862 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: Python main interpreter initialized at 0x559d367bb9c0 Nov 16 18:52:42.090862 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: python threads support enabled Nov 16 18:52:42.090862 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: your server socket listen backlog is limited to 100 connections Nov 16 18:52:42.090862 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: your mercy for graceful operations on workers is 90 seconds Nov 16 18:52:42.091282 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 18:52:42.091282 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: *** Operational MODE: preforking *** Nov 16 18:52:42.091573 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: *** uWSGI is running in multiple interpreter mode *** Nov 16 18:52:42.091573 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: spawned uWSGI master process (pid: 101002) Nov 16 18:52:42.091805 dv-cinder-667108-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 16 18:52:42.092745 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: spawned uWSGI worker 1 (pid: 101003, cores: 1) Nov 16 18:52:42.092745 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: spawned uWSGI worker 2 (pid: 101004, cores: 1) Nov 16 18:52:42.092915 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 18:52:43.711631 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 18:52:43.711631 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: from cryptography.utils import int_from_bytes Nov 16 18:52:43.712320 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 18:52:43.712320 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: from cryptography.utils import int_from_bytes Nov 16 18:52:43.714065 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 18:52:43.714065 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: from cryptography.utils import int_from_bytes Nov 16 18:52:43.714601 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 18:52:43.714601 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: from cryptography.utils import int_from_bytes Nov 16 18:52:46.220558 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 18:52:46.221198 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 18:52:46.221198 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 18:52:46.221714 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 18:52:46.221714 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 18:52:46.221951 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 18:52:46.221951 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 18:52:46.222170 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 18:52:46.222290 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 18:52:46.222454 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 18:52:46.222454 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.222587 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.222587 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.222706 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.222885 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.222978 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.223199 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.223292 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.223522 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.223609 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.223827 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.223912 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.224143 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.224247 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.224458 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.224563 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.224780 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.224871 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.225035 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.225119 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.225346 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.225437 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.225688 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-667108-35-iscsi {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.225774 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-667108-35-iscsi {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.226008 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.226141 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.226307 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.226403 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.226614 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.226704 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.226927 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.227009 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.227227 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.227320 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.227542 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.227623 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.227841 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.227934 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.228334 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.228441 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.228772 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.228883 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.229078 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.229207 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.229388 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.229515 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.229739 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.229863 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.230050 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.230185 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.230354 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.230438 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.230670 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.230754 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.231001 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.231099 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.231321 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.231404 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.231625 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.231711 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.232026 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-667108-35-iscsi {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.232127 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-667108-35-iscsi {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.232333 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.232432 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.232674 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.232761 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.232940 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.233025 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.233350 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.233475 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.233685 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.233793 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.233988 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.234114 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.234318 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.234418 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.234627 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.234716 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.234929 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.235021 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.235251 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.235335 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.235565 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.235693 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.235881 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.235982 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.236194 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.236279 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.236492 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.236596 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.236795 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.236877 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.237097 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.237189 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.237410 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.237507 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.237870 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.237953 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.238043 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.238122 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.238259 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.238357 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.238562 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.238672 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.238879 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.238962 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.239196 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.239280 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.239512 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.239611 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.239758 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.239842 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.240004 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.240089 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.240318 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.240409 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.240632 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.240776 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.240935 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.241019 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.241236 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.241318 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.241539 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.241653 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.241863 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.241957 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.242165 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.242253 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.242466 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.242550 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.242767 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.242851 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.243068 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.243151 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.243379 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.243461 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.243687 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.243769 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.244030 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.244120 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.244302 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.244387 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.244615 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.244708 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.245005 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.245086 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.245252 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.245349 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.245567 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.245655 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.245907 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.245992 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.246203 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.246290 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.247033 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.247124 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.247352 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.247447 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.247667 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.247749 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.247971 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.248086 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.248267 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.248431 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.248568 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.248658 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.248882 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.248964 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.249209 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.249300 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.249508 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.249660 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.249847 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.249931 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.250152 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.250264 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.250443 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.250527 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.250754 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.250835 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.251053 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.251141 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.251353 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.251443 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.251653 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.251742 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.251948 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.252049 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.252248 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.252330 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.252549 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.252631 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.252848 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.252941 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.253147 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.253229 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.253447 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.253531 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.253771 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.253857 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.254071 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.254154 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.254368 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.254450 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.254923 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.255017 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.255233 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.255317 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.255544 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.255636 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.255846 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.255928 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.256146 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.256246 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.256442 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.256534 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.256741 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.256830 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.257053 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.257144 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.257353 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.257435 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.257673 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.257761 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.257993 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.258112 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.258287 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.258391 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.258585 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.258668 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.258896 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.258978 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.259198 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.259398 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.259479 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.259554 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.259793 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.259884 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.260088 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.260195 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.260386 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.260470 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.260694 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.260785 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.260993 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.261085 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.261358 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.261490 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.261605 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.261697 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.261905 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.262050 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.262783 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.262909 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.263088 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.263183 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.263385 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.263479 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.263719 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.263818 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.263981 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.264085 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.264293 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.264383 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.264607 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.264705 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.264909 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.265000 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.265209 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.265299 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.265508 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.265630 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.265847 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.265937 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 18:52:46.266178 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.266275 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.266500 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.266597 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.266838 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.266965 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.267147 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.267242 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.267473 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.267563 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.267797 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.267895 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.268181 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.268277 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.268421 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.268535 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.268722 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.268825 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.269042 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.269127 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.269353 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.269480 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.269679 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.269769 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.269987 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.270081 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.270299 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.270389 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.270612 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.270697 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.270938 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.271114 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.271243 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.271329 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.271550 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.271644 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.271868 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.271952 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.272173 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.272262 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.272485 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.272569 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.272807 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.272898 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.273124 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.273207 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.273432 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.273515 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.273793 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.273890 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.274131 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.274221 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.274440 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.274536 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.274759 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.274844 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.275066 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.275176 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.275380 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.275472 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.275688 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.275771 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.275996 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.276112 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.276302 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.276394 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.276628 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.276713 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.276935 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.277030 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.277241 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.277331 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.277591 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.277679 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.277934 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.278034 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.278295 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.278392 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.278550 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.278633 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.278850 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.278935 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.279149 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.279233 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.279454 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.279546 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.279753 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.279839 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.280074 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.280176 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.280393 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.280477 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.280694 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.280779 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.281023 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.281114 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.281328 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.281417 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.281656 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.281747 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.281965 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.282049 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.282268 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.282361 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.282576 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.282659 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.282880 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.282962 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.283179 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.283270 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.283497 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.283588 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.283804 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.283887 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.284105 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.284202 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.284426 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.284509 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.284728 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.284819 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.285029 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.285183 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.285339 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.285422 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.285671 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.285760 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.285982 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.286067 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.286288 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.286371 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.286606 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.286690 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.286915 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.287000 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.287219 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.287301 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.287548 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.287640 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.287873 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.287965 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.288174 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.288258 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.288495 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.288569 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.288815 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.288906 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.289125 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.289208 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.289425 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.289516 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.289756 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.289848 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.290057 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.290186 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.290356 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.290449 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.290656 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.290740 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.290959 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.291049 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.291258 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.291355 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.291559 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.291657 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.291854 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.291938 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.292151 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.292244 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.292450 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.292543 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.292767 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.292850 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.293070 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.293154 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.293391 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.293481 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.293720 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.293806 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.294020 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.294112 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.294355 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.294438 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.294656 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.294740 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.294993 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.295078 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.295324 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.295409 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.295642 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.295733 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.295959 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.296052 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.296268 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.296350 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.296578 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.296670 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.296885 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.296968 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.297190 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.297273 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.297498 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.297610 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.297830 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.297913 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.298144 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.298234 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.298452 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.298614 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.298766 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.298857 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.299071 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.299162 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.299391 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.299483 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.299695 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.299779 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.300011 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.300093 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.300312 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.300403 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.300623 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.300714 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.300955 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.301045 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.301283 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.301369 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.301615 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.301703 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.301938 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.302022 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.302244 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.302329 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.302554 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.302637 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.302856 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.302941 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.303161 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.303246 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.303466 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.303555 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.303769 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.303853 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.304081 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.304166 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.304387 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.304479 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.304697 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.304788 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.305002 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.305086 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.305318 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.305397 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.305650 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.305752 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.305966 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.306049 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.306266 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.306348 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.306577 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.306668 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.306901 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.306990 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.307230 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.307475 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.307562 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.307795 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.307887 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.308110 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.308193 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.308428 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.308511 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.308735 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.308828 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.309596 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.309717 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.309900 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.309998 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.310203 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.310287 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.310507 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.310590 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.310814 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.310910 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.311119 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.311209 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.311425 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.311516 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.311727 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.311824 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.312028 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.312111 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.312335 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.312455 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.312633 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.312736 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.312932 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.313016 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.313238 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.313322 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.313598 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.313687 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.313888 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.313974 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.314195 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.314279 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.314511 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.314596 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.314814 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.314899 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.315115 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.315207 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.315420 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.315554 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.315729 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.315819 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.316029 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.316114 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.316329 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.316414 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.316627 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.316710 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.316927 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.317022 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.317260 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.317345 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.317589 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.317730 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.317886 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.317984 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.318200 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.318284 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.318502 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.318585 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.318812 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.318903 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.319116 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.319212 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.319421 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.319504 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.319728 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.319821 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.320038 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.320126 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.320342 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.320426 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.320649 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.320740 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.320956 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.321046 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.321260 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.321344 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.321582 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.321670 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.321894 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.321979 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.322201 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.322283 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.322504 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.322590 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.322808 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.322894 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.323109 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.323192 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.323405 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.323490 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.323711 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.323795 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.324030 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.324290 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.324591 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.324706 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.325481 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.325748 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.325836 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.326176 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.326271 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.326495 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.326741 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.326825 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.327137 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.327229 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.327448 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.327612 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.327749 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.327949 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.328055 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.328278 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.328363 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.328591 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.328675 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.328990 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.329175 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.329258 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.329335 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.329499 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.329739 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.329824 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.329914 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.330123 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.330215 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.330423 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.330506 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.330722 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.330814 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.331026 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.331112 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.331334 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.331417 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.331635 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.331732 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.331978 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.332116 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.332244 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.332328 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.332545 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.332631 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.332865 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.332964 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.333167 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.333250 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.333466 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.333582 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.333791 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.333882 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.334107 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.334201 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.334404 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.334489 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.334706 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.334800 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.335008 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.335090 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.335318 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.335403 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.335660 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.335746 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.335965 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.336049 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.336267 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.336357 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.336591 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.336677 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.336896 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.336981 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.337198 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.337282 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.337499 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.337625 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.337835 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.337928 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.338138 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.338221 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.338435 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.338519 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.338732 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.338829 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.339115 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.339224 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.339339 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.339423 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.339638 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.339722 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.339938 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.340076 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.340267 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.340351 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.340571 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.340662 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.340877 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.341180 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.341254 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.341490 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.341592 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.341819 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.341894 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.342132 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.342251 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.342446 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.342530 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.342758 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.342841 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.343065 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.343140 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.343385 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.343474 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.343683 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.343767 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.343999 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.344073 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.344306 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.344380 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.344607 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.344689 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.344908 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.344981 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.345226 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.345315 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.345529 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.345698 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.345854 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.345943 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.346181 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.346261 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.346491 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.346572 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.346798 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.346906 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.347154 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.347240 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.347402 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.347477 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.347709 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.347803 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.348044 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.348189 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.348309 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.348403 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.348630 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.348722 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.348946 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.349030 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.349254 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.349370 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.349569 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.349658 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.349881 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.349987 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.350182 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.350275 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.350487 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.350581 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.350791 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.350889 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.351090 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.351183 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.351388 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.351472 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.351686 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.351840 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.351986 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.352073 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.352285 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.352369 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.352602 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.352766 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.352906 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.352991 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.353204 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.353287 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.353505 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.353620 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.353830 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.353916 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.354128 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.354211 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.354429 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.354515 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.354731 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.354815 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.355075 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.355160 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.355382 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.355468 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.355701 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.355784 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.356046 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.356137 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.356359 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.356478 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.356671 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.356785 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.356974 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.357096 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.357281 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.357389 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.357608 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.357736 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.357912 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.358031 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.358214 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.358324 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.358516 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.358626 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.358824 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.358945 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.359129 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.359259 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.359433 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.359572 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.359753 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.359902 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.360073 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.360241 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.360393 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.360553 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.360696 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.360874 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.360995 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.361739 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.361827 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.361923 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362005 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362088 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362166 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362232 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362343 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362506 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362592 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362818 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.362977 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.363127 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.363220 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.363435 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.363527 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.363743 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.363827 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.364044 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.364127 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.364352 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.364437 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.364657 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.364740 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.364965 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.365074 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.365270 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.365356 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.365599 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.365689 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.365906 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.366003 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.366209 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.366292 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.366510 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.366592 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.366819 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.366988 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.367120 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.367205 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.367429 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.367555 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.367731 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.367867 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.368108 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.368209 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.368417 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.368503 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.368764 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.368849 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.369074 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.369160 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.369390 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.369504 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.369734 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.369826 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.370037 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.370129 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.370355 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.370440 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.370671 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.370757 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.370988 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.371295 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.371379 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.372195 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.372300 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.372505 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.372591 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.372811 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.372895 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.373122 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.373214 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.373425 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.373509 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.373761 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.373847 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.374067 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.374160 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.374378 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.374476 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.374675 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.374760 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.374979 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.375065 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.375281 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.375365 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.375602 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.375694 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.375911 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.376004 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.376231 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.376317 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.376645 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.376740 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.376954 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.377039 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.377258 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.377343 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.377619 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.377767 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.377944 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.378079 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.378266 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.378388 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.378571 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.378709 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.378884 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.379027 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.379192 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.379349 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.379808 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.379918 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.380090 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.380202 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.380398 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.380509 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.380711 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.380911 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.381005 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.381134 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.381320 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.381442 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.381662 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.381777 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.381976 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.382082 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.382296 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.382387 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.382707 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.382801 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.383017 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.383101 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.383329 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.383412 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.383650 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.383746 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.383974 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.384068 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.384280 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.384364 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.384583 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.384683 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.384891 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.384985 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.385195 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.385326 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.385498 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.385655 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.385844 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.385929 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.386149 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.386233 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.386453 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.386546 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.386764 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.386856 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.387065 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.387742 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.387917 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.388022 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.388221 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.388310 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.388527 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.388610 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.388828 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.388923 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.389131 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.389249 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.389446 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.389529 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.389770 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.389882 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.390092 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.390186 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.390393 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.390479 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.390710 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.390797 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.391022 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.391118 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.391322 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.391406 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.391622 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.391735 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.391929 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.392067 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.392234 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.392386 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.392534 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.392622 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.392835 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.392920 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.393176 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.393337 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.393477 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.393582 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.393823 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.393909 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.394154 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.394247 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.394479 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.394568 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.394784 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.394867 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.395098 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.395191 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.395420 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.395506 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.395725 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.395810 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.396029 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.396127 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.396337 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.396422 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.396637 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.396720 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.396937 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.397022 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.397240 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.397323 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.397539 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.397654 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.397863 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.397949 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.398164 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.398248 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.398464 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.398547 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.398761 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.398847 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.399063 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.399147 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.399364 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.399450 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.399675 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.399760 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.399972 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.400062 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.400271 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.400363 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.400572 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.400660 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.400871 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.400954 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.401173 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.401271 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.401473 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.401583 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.401847 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.401944 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.402149 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.402242 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.402477 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.402560 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.402818 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.402911 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.403140 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.403233 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.403458 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.403549 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.403762 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.403852 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.404073 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.404162 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.404383 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.404467 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.404736 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.404837 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.405005 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.405091 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.405366 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.405466 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.405645 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.405745 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.405963 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.406050 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.406272 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.406355 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.406578 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.406667 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.407003 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.407148 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.407320 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.407475 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.407637 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.407787 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.408101 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.408195 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.408408 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.408493 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.408718 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.408815 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.409032 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.409153 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.409335 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.409470 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.409672 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.409810 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.409982 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.410126 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.410292 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.410433 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.410613 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.410743 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.410932 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.411051 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.411258 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.411357 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.411587 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.411675 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.411901 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.411994 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.412213 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.412313 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.412523 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.412610 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.412834 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.412918 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.413183 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.413281 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.413494 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.413598 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.413835 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.413922 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.414147 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.414248 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.414460 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.414548 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.414776 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.414904 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.415082 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.415176 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.415387 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.415492 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.415698 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.415783 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.416008 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.416109 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.416313 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.416406 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.416623 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.416708 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.416933 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.417042 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.417237 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.417322 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.417613 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.417720 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.417872 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.417955 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.418173 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.418258 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.418524 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.418626 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.418849 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.418933 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.419164 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.419248 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.419476 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.419689 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.419782 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.420000 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.420104 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.420337 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.420595 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.420683 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.420908 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.420994 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.421237 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.421382 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.421613 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.421723 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.421910 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.422035 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.422212 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.422297 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.422517 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.422604 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.422827 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.422911 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.423126 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.423209 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.423426 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.423510 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.423732 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.423816 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.424040 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.424139 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.424338 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.424422 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.424653 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.424735 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.424967 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.425088 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.425263 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.425487 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.425593 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.425862 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.425948 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.426178 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.426420 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.426508 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.426769 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.426854 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.427086 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.427180 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.427407 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.427539 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.427727 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.427814 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.428030 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.428128 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.428333 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.428417 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.428646 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.428730 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.428948 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.429034 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.429248 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.429331 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.429570 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.429658 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.429881 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.429968 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.430185 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.430278 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.430495 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.430591 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.430801 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.430895 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.431103 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.431195 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.431407 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.431545 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.431715 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.431813 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.432021 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.432161 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.432318 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.432413 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.432631 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.432727 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.432929 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.433020 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.433229 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.433322 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.433530 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.433664 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.433854 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.433940 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.434689 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.434789 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.434992 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.435080 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.435291 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.435382 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.435592 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.435683 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.435892 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.435973 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.436192 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.436283 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.436495 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.436582 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.436793 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.436876 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.437093 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.437179 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.437402 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.437488 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.437727 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.437813 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.438044 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.438128 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.438346 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.438433 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.438650 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.438735 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.438960 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.439055 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.439266 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.439357 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.439589 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.439700 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.439901 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.439999 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.440211 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.440436 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.440557 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.440817 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.440901 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.441139 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.441396 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.441488 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.441802 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.441890 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.442123 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.442258 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.442426 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.442509 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.442732 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.442818 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.443054 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.443147 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.443364 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.443456 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.443668 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.443759 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.443974 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.444082 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.444281 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.444367 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.444587 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.444671 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.444892 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.444978 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.445199 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.445282 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.445503 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.445631 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.445836 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.445922 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.446147 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.446234 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.446457 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.446551 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.446765 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.446852 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.447084 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.447168 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.447399 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.447492 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.447709 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.447793 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.448024 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.448222 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.448317 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.448404 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.448621 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.448711 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.448926 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.449017 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.449233 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.449320 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.449539 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.450249 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.450433 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.450516 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.450767 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.450872 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.451075 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.451163 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.451381 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.451467 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.451770 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.451874 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.452079 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.452178 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.452397 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.452553 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.452718 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.452837 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.453026 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.453111 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.453343 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.453436 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.453676 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.453785 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.453987 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.454082 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.454306 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.454404 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.454616 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.454701 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.454944 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.455053 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.455250 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.455343 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.455552 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.455638 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.455854 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.455946 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.456164 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.456259 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.456494 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.456578 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.456796 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.456888 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.457105 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.457193 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.457418 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.457502 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.457758 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.457857 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.458066 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.458150 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.458373 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.458465 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.458693 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.458785 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.458998 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.459082 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.459304 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.459390 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.459624 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.459717 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.459930 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.460026 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.460236 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.460320 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.460545 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.460640 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.460858 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.460957 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.461159 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.461244 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.461465 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.461577 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.461798 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.461891 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.462107 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.462205 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.462414 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.462508 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.462737 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.462822 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.463055 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.463140 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.463356 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.463442 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.463674 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.463767 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.463984 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.464091 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.464298 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.464388 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.464607 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.464691 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.464911 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.465004 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.465243 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.465332 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.465599 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.465688 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.465892 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.465991 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.466203 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.466329 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.466511 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.466604 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.466823 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.466909 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.467135 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.467220 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.467459 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.467543 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.467781 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.467911 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.468099 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.468187 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.468418 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.468502 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.468751 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.468843 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.469056 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.469140 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.469365 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.469447 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.469700 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.469800 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.469945 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101004) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 18:52:46.470033 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.470327 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.470674 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 18:52:46.470874 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 18:52:46.492365 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_db.sqlalchemy.engines [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 18:52:46.493384 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG oslo_db.sqlalchemy.engines [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 18:52:46.561596 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.context [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad1d2f2-15e4-42bc-bf20-68092f43efab(cell1) {{(pid=101003) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 18:52:46.561875 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.context [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad1d2f2-15e4-42bc-bf20-68092f43efab(cell1) {{(pid=101004) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 18:52:46.565837 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG oslo_concurrency.lockutils [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:52:46.565950 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:52:46.567421 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG oslo_concurrency.lockutils [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:52:46.567521 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:52:46.568240 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG oslo_concurrency.lockutils [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:52:46.568410 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:52:46.570193 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG oslo_concurrency.lockutils [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:52:46.570359 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:52:46.584346 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG oslo_db.sqlalchemy.engines [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 18:52:46.587267 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_db.sqlalchemy.engines [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 18:52:46.591372 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_db.sqlalchemy.engines [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 18:52:46.591551 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG oslo_db.sqlalchemy.engines [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 18:52:46.914196 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_db.sqlalchemy.engines [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101004) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 18:52:46.937524 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG oslo_db.sqlalchemy.engines [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 18:52:47.270496 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: WARNING keystonemiddleware.auth_token [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 18:52:47.272926 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: WARNING keystonemiddleware.auth_token [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 18:52:47.278073 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: WARNING keystonemiddleware.auth_token [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 18:52:47.279444 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: WARNING keystonemiddleware.auth_token [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 18:52:47.500346 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: WARNING keystonemiddleware.auth_token [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 18:52:47.505721 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: WARNING keystonemiddleware.auth_token [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 18:52:47.509360 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: WARNING keystonemiddleware.auth_token [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 18:52:47.511097 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559d367bb9c0 pid: 101003 (default app) Nov 16 18:52:47.513283 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:52:47.514478 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 Nov 16 18:52:47.514894 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Tue Nov 16 18:52:47 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:52:47.518712 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: WARNING keystonemiddleware.auth_token [None req-ea2dc22f-4ff9-439f-a953-1deab7121829 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 18:52:47.526324 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559d367bb9c0 pid: 101004 (default app) Nov 16 18:54:14.125913 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:14.126886 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Nov 16 18:54:14.127451 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 18:54:14.824546 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-fbc9ab46-d7ed-4241-aa8d-48780523797d admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:14.873013 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-fbc9ab46-d7ed-4241-aa8d-48780523797d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.737170 Nov 16 18:54:14.873952 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 16 18:54:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:54:17.330035 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:17.331027 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-5547a981-7e58-45b4-93ac-e806cbba5165 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 16 18:54:17.331423 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:17.408712 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-10fd784f-ec9f-4c63-82f5-697af64ab824 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:17.427965 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 18:54:17.427965 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: warnings.warn(msg) Nov 16 18:54:17.467437 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-10fd784f-ec9f-4c63-82f5-697af64ab824 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.128072 Nov 16 18:54:17.468114 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:17 2021] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 18:54:17.812461 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-96247bed-bac9-476a-9ef8-73714331a607 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:17.812461 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 18:54:17.812461 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: warnings.warn(msg) Nov 16 18:54:17.863895 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-96247bed-bac9-476a-9ef8-73714331a607 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.387027 Nov 16 18:54:17.864395 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 18:54:17 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 18:54:20.386318 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-10fd784f-ec9f-4c63-82f5-697af64ab824 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:20.387448 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-10fd784f-ec9f-4c63-82f5-697af64ab824 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Nov 16 18:54:20.387943 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:20.513494 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-7572127b-4b08-41ae-9f28-fb54e180e7b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:20.531231 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 18:54:20.531231 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: warnings.warn(msg) Nov 16 18:54:20.553684 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-7572127b-4b08-41ae-9f28-fb54e180e7b1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157938 Nov 16 18:54:20.554059 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:54:20.568733 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-28cf0ce0-82b5-46ad-b087-6c2c7cd995ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:20.574459 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 18:54:20.574459 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: warnings.warn(msg) Nov 16 18:54:20.615584 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-28cf0ce0-82b5-46ad-b087-6c2c7cd995ac admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051883 Nov 16 18:54:20.616586 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 18:54:20 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 18:54:23.150548 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-7572127b-4b08-41ae-9f28-fb54e180e7b1 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:23.152304 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-7572127b-4b08-41ae-9f28-fb54e180e7b1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002407 Nov 16 18:54:23.152927 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:23 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:23.219812 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-28896fea-7e2f-49b2-b10e-f1a3fb956d73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "swap": 0, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:23.239142 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-28896fea-7e2f-49b2-b10e-f1a3fb956d73 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077783 Nov 16 18:54:23.241625 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:54:23.252729 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-a4a7068b-b6eb-46b7-a317-9a19be48ed75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:23.278867 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-a4a7068b-b6eb-46b7-a317-9a19be48ed75 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029691 Nov 16 18:54:23.279982 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 18:54:23 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:54:25.688339 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-28896fea-7e2f-49b2-b10e-f1a3fb956d73 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:25.689345 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-28896fea-7e2f-49b2-b10e-f1a3fb956d73 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 16 18:54:25.689788 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 18:54:25.766822 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-b68b16aa-62ac-4da5-b3d9-1ab11089c981 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "ram": 2048, "swap": 0, "id": "d3"}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:25.792752 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-b68b16aa-62ac-4da5-b3d9-1ab11089c981 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094341 Nov 16 18:54:25.793499 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:54:25.805958 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-8a699d6b-ee7d-4962-8f96-ae488e3e42ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:25.831238 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-8a699d6b-ee7d-4962-8f96-ae488e3e42ab admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028910 Nov 16 18:54:25.831820 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 18:54:25 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:54:28.414771 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-b68b16aa-62ac-4da5-b3d9-1ab11089c981 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:28.417536 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-b68b16aa-62ac-4da5-b3d9-1ab11089c981 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003683 Nov 16 18:54:28.418612 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:28 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:28.502525 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-becdf9b2-8501-4f4c-a552-dc7f99091762 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "d4", "name": "ds4G", "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:28.534340 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-becdf9b2-8501-4f4c-a552-dc7f99091762 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.107334 Nov 16 18:54:28.535464 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:28 2021] POST /compute/v2.1/flavors => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:54:28.550389 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-f6baf3b0-6994-4891-9dc9-419ea7e280fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:28.578665 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-f6baf3b0-6994-4891-9dc9-419ea7e280fb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032530 Nov 16 18:54:28.582239 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Tue Nov 16 18:54:28 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:54:31.079415 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-becdf9b2-8501-4f4c-a552-dc7f99091762 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:31.080896 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-becdf9b2-8501-4f4c-a552-dc7f99091762 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Nov 16 18:54:31.080896 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:31.144011 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-1a7821d3-3c83-4a31-a218-d4c4c3cea30f admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:31.169046 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-1a7821d3-3c83-4a31-a218-d4c4c3cea30f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080392 Nov 16 18:54:31.170784 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 16 18:54:31 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:54:33.732286 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-becdf9b2-8501-4f4c-a552-dc7f99091762 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:33.733280 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-becdf9b2-8501-4f4c-a552-dc7f99091762 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 16 18:54:33.733721 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 18:54:33.807805 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-7f11750c-140d-4344-9cc5-3eca6a284ce0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:33.833987 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-7f11750c-140d-4344-9cc5-3eca6a284ce0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.093113 Nov 16 18:54:33.834568 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:33 2021] POST /compute/v2.1/flavors => generated 402 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:54:33.848482 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-865fd315-8a74-4dd8-b079-1a0e62658251 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:33.875282 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-865fd315-8a74-4dd8-b079-1a0e62658251 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030369 Nov 16 18:54:33.876092 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 18:54:33 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:54:36.264856 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-7f11750c-140d-4344-9cc5-3eca6a284ce0 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:36.266117 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-7f11750c-140d-4344-9cc5-3eca6a284ce0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Nov 16 18:54:36.266300 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:36.330941 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-f064685e-1fd1-4df3-b2f2-d17a3332d999 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "disk": 20, "id": "2", "ram": 2048}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:36.352525 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-f064685e-1fd1-4df3-b2f2-d17a3332d999 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079203 Nov 16 18:54:36.353826 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 18:54:36.366473 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-b14565e5-e30e-47fc-834b-61b9a1d7bae0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:36.394366 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-b14565e5-e30e-47fc-834b-61b9a1d7bae0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031606 Nov 16 18:54:36.394953 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 18:54:36 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:54:39.133528 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-f064685e-1fd1-4df3-b2f2-d17a3332d999 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:39.135687 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-f064685e-1fd1-4df3-b2f2-d17a3332d999 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002474 Nov 16 18:54:39.136563 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:39 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:39.220634 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-ba1cb3ab-5e1f-496a-8f59-9a16cd5dbe00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:39.247950 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-ba1cb3ab-5e1f-496a-8f59-9a16cd5dbe00 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.103781 Nov 16 18:54:39.248811 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:39 2021] POST /compute/v2.1/flavors => generated 406 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:54:39.265700 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-39c75dfb-58e8-4065-b755-12ee4e18c4ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:39.292843 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-39c75dfb-58e8-4065-b755-12ee4e18c4ab admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031337 Nov 16 18:54:39.293420 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 18:54:39 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:54:41.663823 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-ba1cb3ab-5e1f-496a-8f59-9a16cd5dbe00 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:41.666707 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-ba1cb3ab-5e1f-496a-8f59-9a16cd5dbe00 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003855 Nov 16 18:54:41.667924 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:41 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:41.729529 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-99db6109-5b89-4b0e-81c3-94633ddf4400 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "ram": 8192, "id": "4", "disk": 80}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:41.753778 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-99db6109-5b89-4b0e-81c3-94633ddf4400 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078270 Nov 16 18:54:41.754726 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:41 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:54:41.776603 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-cffd214f-2a09-4dc5-bf80-b27f06b5de7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:41.811240 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-cffd214f-2a09-4dc5-bf80-b27f06b5de7b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040748 Nov 16 18:54:41.817741 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 18:54:41 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:54:44.197352 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-99db6109-5b89-4b0e-81c3-94633ddf4400 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:54:44.198608 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-99db6109-5b89-4b0e-81c3-94633ddf4400 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Nov 16 18:54:44.199525 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:54:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:54:44.273105 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-89427437-915e-4859-a23d-ec8be1de3303 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:44.294613 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-89427437-915e-4859-a23d-ec8be1de3303 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.088537 Nov 16 18:54:44.295180 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Tue Nov 16 18:54:44 2021] POST /compute/v2.1/flavors => generated 408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:54:44.309825 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-08d47110-56d4-4f17-a8f6-d00a9f1edf60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:54:44.335099 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-08d47110-56d4-4f17-a8f6-d00a9f1edf60 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029459 Nov 16 18:54:44.335706 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Tue Nov 16 18:54:44 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:55:26.810953 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-89427437-915e-4859-a23d-ec8be1de3303 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:26.811953 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-89427437-915e-4859-a23d-ec8be1de3303 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 16 18:55:26.812348 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:55:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:55:26.871124 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-3127b0d2-5a13-46a2-ba35-4c669e1e3dfe admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:26.888557 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-3127b0d2-5a13-46a2-ba35-4c669e1e3dfe admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069477 Nov 16 18:55:26.889091 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 16 18:55:26 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 18:55:28.429317 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-89427437-915e-4859-a23d-ec8be1de3303 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:28.430324 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-89427437-915e-4859-a23d-ec8be1de3303 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Nov 16 18:55:28.430714 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:55:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:55:28.622244 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-b34247e0-1aeb-41ac-8b60-17ce38b4362a admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:28.627730 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.wsgi [None req-b34247e0-1aeb-41ac-8b60-17ce38b4362a admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 16 18:55:28.628470 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-b34247e0-1aeb-41ac-8b60-17ce38b4362a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101004) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 18:55:28.629114 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-b34247e0-1aeb-41ac-8b60-17ce38b4362a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061053 Nov 16 18:55:28.629656 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 16 18:55:28 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 18:55:28.639663 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-57d9d96d-6d2d-47e5-8c14-68bf64570b6b admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:28.659658 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-57d9d96d-6d2d-47e5-8c14-68bf64570b6b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023425 Nov 16 18:55:28.660240 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 18:55:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:55:28.671609 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-79bc16ee-b0eb-4f6c-94db-d16190a2dcb2 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:28.695145 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-79bc16ee-b0eb-4f6c-94db-d16190a2dcb2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027397 Nov 16 18:55:28.695707 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 18:55:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 18:55:28.705729 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-7bf430d2-41e1-4e06-b68c-c05cf9e93845 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:28.711132 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.wsgi [None req-7bf430d2-41e1-4e06-b68c-c05cf9e93845 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 16 18:55:28.711687 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-7bf430d2-41e1-4e06-b68c-c05cf9e93845 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 18:55:28.712460 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-7bf430d2-41e1-4e06-b68c-c05cf9e93845 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010286 Nov 16 18:55:28.712957 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 16 18:55:28 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 18:55:30.117105 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-79bc16ee-b0eb-4f6c-94db-d16190a2dcb2 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:30.118131 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-79bc16ee-b0eb-4f6c-94db-d16190a2dcb2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 16 18:55:30.118525 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:55:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 18:55:30.311165 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-52be28b2-1ade-45d1-bae7-faa9d970e50a admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:30.316933 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.wsgi [None req-52be28b2-1ade-45d1-bae7-faa9d970e50a admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 16 18:55:30.317483 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-52be28b2-1ade-45d1-bae7-faa9d970e50a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 18:55:30.318292 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-52be28b2-1ade-45d1-bae7-faa9d970e50a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059140 Nov 16 18:55:30.318793 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 16 18:55:30 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 18:55:30.328543 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-1c41f2ff-79d5-4bc6-960b-fd050b865ca7 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:30.341782 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-1c41f2ff-79d5-4bc6-960b-fd050b865ca7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016791 Nov 16 18:55:30.342317 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 18:55:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:55:30.352259 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-8e22068a-ac35-4bb7-8b91-71e64b3eed34 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:30.366375 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-8e22068a-ac35-4bb7-8b91-71e64b3eed34 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017540 Nov 16 18:55:30.366950 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 18:55:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:55:30.377424 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-318e9191-3274-47e4-89d1-b10f3bef161f admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:30.382926 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.wsgi [None req-318e9191-3274-47e4-89d1-b10f3bef161f admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 16 18:55:30.383472 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-318e9191-3274-47e4-89d1-b10f3bef161f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101004) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 18:55:30.384239 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-318e9191-3274-47e4-89d1-b10f3bef161f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010390 Nov 16 18:55:30.384731 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Tue Nov 16 18:55:30 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 18:55:31.777984 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-8e22068a-ac35-4bb7-8b91-71e64b3eed34 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:31.779078 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-8e22068a-ac35-4bb7-8b91-71e64b3eed34 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Nov 16 18:55:31.779471 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:55:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:55:31.968424 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-180fa42c-6a66-47ac-894b-5dd3b6bb9e5f admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:31.973587 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.wsgi [None req-180fa42c-6a66-47ac-894b-5dd3b6bb9e5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 16 18:55:31.974133 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-180fa42c-6a66-47ac-894b-5dd3b6bb9e5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101004) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 18:55:31.974899 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-180fa42c-6a66-47ac-894b-5dd3b6bb9e5f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058357 Nov 16 18:55:31.975396 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 18:55:31 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 18:55:31.985861 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-491417e3-990b-45af-85f8-b12f199a2769 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:31.998989 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-491417e3-990b-45af-85f8-b12f199a2769 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016603 Nov 16 18:55:31.999505 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 18:55:31 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:55:32.010233 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:32.023061 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017120 Nov 16 18:55:32.023596 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Tue Nov 16 18:55:32 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:55:32.033886 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-8ec6c2fb-45fe-4162-bcb5-dcaa5140107d admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:32.039146 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.wsgi [None req-8ec6c2fb-45fe-4162-bcb5-dcaa5140107d admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 16 18:55:32.039699 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-8ec6c2fb-45fe-4162-bcb5-dcaa5140107d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 18:55:32.040469 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-8ec6c2fb-45fe-4162-bcb5-dcaa5140107d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010125 Nov 16 18:55:32.040965 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 18:55:32 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 18:55:33.423619 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:33.424634 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Nov 16 18:55:33.425028 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:55:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:55:33.615819 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-7eafbc57-4dbd-47e2-8ba9-746ee15d4638 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:55:33.634345 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-7eafbc57-4dbd-47e2-8ba9-746ee15d4638 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070853 Nov 16 18:55:33.634895 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 16 18:55:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:55:35.016086 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:35.017168 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Nov 16 18:55:35.017664 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:55:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:55:35.211085 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-6aa94c20-b593-47f4-82ef-08ac654fb969 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:55:35.235272 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-6aa94c20-b593-47f4-82ef-08ac654fb969 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074322 Nov 16 18:55:35.236332 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 16 18:55:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:55:36.630035 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:36.631031 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Nov 16 18:55:36.631459 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:55:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:55:36.826454 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-09afb541-12b3-4aed-9a68-1cc54226ad04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:55:36.845693 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-09afb541-12b3-4aed-9a68-1cc54226ad04 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.074276 Nov 16 18:55:36.846246 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 16 18:55:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:55:38.245141 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:38.246745 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002520 Nov 16 18:55:38.247136 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:55:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:55:38.439199 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-85780e35-a37e-4ee0-affa-79c86a5856f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 18:55:38.456389 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-85780e35-a37e-4ee0-affa-79c86a5856f8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069101 Nov 16 18:55:38.456866 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Tue Nov 16 18:55:38 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:55:39.846238 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:39.847238 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Nov 16 18:55:39.847633 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:55:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:55:40.038803 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-ce4f253a-fdee-402c-a386-505135d79dde admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:55:40.057848 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-ce4f253a-fdee-402c-a386-505135d79dde admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071640 Nov 16 18:55:40.058400 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Tue Nov 16 18:55:39 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:56:26.563410 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:56:26.564431 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-ba3f1994-5c2b-43f4-9c4d-7727ce269891 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 16 18:56:26.564829 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Tue Nov 16 18:56:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:56:26.623461 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-c383ae12-ab9e-4ca9-82e2-f1381dcf8870 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:56:26.642587 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-c383ae12-ab9e-4ca9-82e2-f1381dcf8870 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070859 Nov 16 18:56:26.643115 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Tue Nov 16 18:56:26 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:56:26.665914 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-e626b986-c3c8-4f72-93db-bf7b0dd17a68 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:56:26.674175 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-e626b986-c3c8-4f72-93db-bf7b0dd17a68 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011823 Nov 16 18:56:26.674705 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Tue Nov 16 18:56:26 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:56:26.687170 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-035ce314-2625-4005-8cf8-75047f4ab5a7 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:56:26.694735 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-035ce314-2625-4005-8cf8-75047f4ab5a7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011070 Nov 16 18:56:26.695268 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Tue Nov 16 18:56:26 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:56:26.707119 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-b1c8bc49-7548-41bf-aa71-05085affa58f admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:56:26.715421 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-b1c8bc49-7548-41bf-aa71-05085affa58f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011743 Nov 16 18:56:26.715974 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Tue Nov 16 18:56:26 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:56:26.728074 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:56:26.736409 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011858 Nov 16 18:56:26.736929 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Tue Nov 16 18:56:26 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 18:57:54.920968 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-c6b2c446-b19f-4485-9243-0f7d4190a982 tempest-verify_tempest_config-495803354 tempest-verify_tempest_config-495803354-project] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:57:54.923214 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-c6b2c446-b19f-4485-9243-0f7d4190a982 tempest-verify_tempest_config-495803354 tempest-verify_tempest_config-495803354-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.123808 Nov 16 18:57:54.923741 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 34/69] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 16 18:57:54 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:59:24.919891 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:59:24.920909 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Nov 16 18:59:24.921294 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 36/70] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:59:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 18:59:25.173354 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-bc42772b-8f47-4a9f-9fa3-1de3eb7da8e6 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:59:25.174527 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 18:59:25.174527 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: warnings.warn(msg) Nov 16 18:59:25.176030 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-bc42772b-8f47-4a9f-9fa3-1de3eb7da8e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:59:25.176456 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-bc42772b-8f47-4a9f-9fa3-1de3eb7da8e6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:59:25.177229 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-bc42772b-8f47-4a9f-9fa3-1de3eb7da8e6 admin admin] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:59:25.177670 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-bc42772b-8f47-4a9f-9fa3-1de3eb7da8e6 admin admin] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:59:25.210535 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-bc42772b-8f47-4a9f-9fa3-1de3eb7da8e6 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.148350 Nov 16 18:59:25.211084 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 35/71] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 18:59:25 2021] GET /compute/v2.1/os-services => generated 794 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:59:26.614900 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:59:26.615835 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Nov 16 18:59:26.616226 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 37/72] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:59:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:59:26.813600 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-30760029-b408-4c1b-85fe-d6224d3c2c17 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:59:26.814773 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 18:59:26.814773 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: warnings.warn(msg) Nov 16 18:59:26.816289 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-30760029-b408-4c1b-85fe-d6224d3c2c17 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:59:26.816731 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-30760029-b408-4c1b-85fe-d6224d3c2c17 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:59:26.817517 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-30760029-b408-4c1b-85fe-d6224d3c2c17 admin admin] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:59:26.817961 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-30760029-b408-4c1b-85fe-d6224d3c2c17 admin admin] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:59:26.838270 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-30760029-b408-4c1b-85fe-d6224d3c2c17 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080364 Nov 16 18:59:26.838888 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 36/73] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 18:59:26 2021] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 18:59:38.661469 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:59:38.662474 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 16 18:59:38.662880 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 38/74] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:59:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:59:38.853092 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-b1e818cd-e6f7-4dba-aefa-874c22188046 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:59:38.854277 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 18:59:38.854277 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: warnings.warn(msg) Nov 16 18:59:38.855780 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-b1e818cd-e6f7-4dba-aefa-874c22188046 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:59:38.856214 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-b1e818cd-e6f7-4dba-aefa-874c22188046 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:59:38.857028 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-b1e818cd-e6f7-4dba-aefa-874c22188046 admin admin] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:59:38.857476 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-b1e818cd-e6f7-4dba-aefa-874c22188046 admin admin] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:59:38.881671 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-b1e818cd-e6f7-4dba-aefa-874c22188046 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079046 Nov 16 18:59:38.882222 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 37/75] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 18:59:38 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 18:59:40.309109 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: DEBUG nova.api.openstack.wsgi [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] Calling method '>' {{(pid=101003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:59:40.310144 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: INFO nova.api.openstack.requestlog [None req-d745d405-68fb-48fd-b4b8-f9a573b96314 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Nov 16 18:59:40.310556 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: [pid: 101003|app: 0|req: 39/76] 10.222.0.46 () {56 vars in 1074 bytes} [Tue Nov 16 18:59:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 18:59:40.503922 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG nova.api.openstack.wsgi [None req-c9bc2196-0915-4ba0-8d70-c8cf7405f5e7 admin admin] Calling method '>' {{(pid=101004) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 18:59:40.505071 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 18:59:40.505071 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: warnings.warn(msg) Nov 16 18:59:40.506617 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-c9bc2196-0915-4ba0-8d70-c8cf7405f5e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:59:40.507050 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-c9bc2196-0915-4ba0-8d70-c8cf7405f5e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:59:40.507865 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-c9bc2196-0915-4ba0-8d70-c8cf7405f5e7 admin admin] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 18:59:40.508278 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: DEBUG oslo_concurrency.lockutils [None req-c9bc2196-0915-4ba0-8d70-c8cf7405f5e7 admin admin] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101004) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 18:59:40.531447 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: INFO nova.api.openstack.requestlog [None req-c9bc2196-0915-4ba0-8d70-c8cf7405f5e7 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077402 Nov 16 18:59:40.531926 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: [pid: 101004|app: 0|req: 38/77] 10.222.0.46 () {60 vars in 1193 bytes} [Tue Nov 16 18:59:40 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:00:37.039199 dv-cinder-667108-35-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 16 19:00:37.040081 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: Tue Nov 16 19:00:37 2021 - graceful shutdown triggered... Nov 16 19:00:37.040583 dv-cinder-667108-35-iscsi devstack@n-api.service[101003]: Gracefully killing worker 1 (pid: 101003)... Nov 16 19:00:37.041676 dv-cinder-667108-35-iscsi devstack@n-api.service[101004]: Gracefully killing worker 2 (pid: 101004)... Nov 16 19:00:38.041295 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: worker 1 buried after 1 seconds Nov 16 19:00:38.041295 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: worker 2 buried after 1 seconds Nov 16 19:00:38.041295 dv-cinder-667108-35-iscsi devstack@n-api.service[101002]: goodbye to uWSGI. Nov 16 19:00:38.043027 dv-cinder-667108-35-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 16 19:00:38.043582 dv-cinder-667108-35-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 16 19:00:38.046358 dv-cinder-667108-35-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 16 19:00:38.055648 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 16 19:00:38.058360 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 19:00:38 2021] *** Nov 16 19:00:38.058521 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 19:00:38.058658 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 19:00:38.058772 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: nodename: dv-cinder-667108-35-iscsi Nov 16 19:00:38.058903 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: machine: x86_64 Nov 16 19:00:38.059024 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: clock source: unix Nov 16 19:00:38.059139 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: pcre jit disabled Nov 16 19:00:38.059286 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: detected number of CPU cores: 4 Nov 16 19:00:38.059438 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: current working directory: / Nov 16 19:00:38.059582 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: detected binary path: /usr/bin/uwsgi-core Nov 16 19:00:38.059744 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: your processes number limit is 47680 Nov 16 19:00:38.059891 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: your memory page size is 4096 bytes Nov 16 19:00:38.060050 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: detected max file descriptor number: 2048 Nov 16 19:00:38.060785 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: lock engine: pthread robust mutexes Nov 16 19:00:38.061141 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: thunder lock: enabled Nov 16 19:00:38.061335 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 16 19:00:38.061434 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 19:00:38.106990 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: Python main interpreter initialized at 0x55eaaebf29c0 Nov 16 19:00:38.106990 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: python threads support enabled Nov 16 19:00:38.106990 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: your server socket listen backlog is limited to 100 connections Nov 16 19:00:38.106990 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: your mercy for graceful operations on workers is 90 seconds Nov 16 19:00:38.107396 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 19:00:38.107396 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: *** Operational MODE: preforking *** Nov 16 19:00:38.107657 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: *** uWSGI is running in multiple interpreter mode *** Nov 16 19:00:38.107657 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: spawned uWSGI master process (pid: 116148) Nov 16 19:00:38.107862 dv-cinder-667108-35-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 16 19:00:38.108646 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: spawned uWSGI worker 1 (pid: 116168, cores: 1) Nov 16 19:00:38.108820 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: spawned uWSGI worker 2 (pid: 116169, cores: 1) Nov 16 19:00:38.109582 dv-cinder-667108-35-iscsi devstack@n-api.service[116148]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 19:00:39.875075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 19:00:39.875075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: from cryptography.utils import int_from_bytes Nov 16 19:00:39.875767 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 19:00:39.875767 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: from cryptography.utils import int_from_bytes Nov 16 19:00:39.875931 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 19:00:39.875931 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: from cryptography.utils import int_from_bytes Nov 16 19:00:39.876379 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 19:00:39.876379 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: from cryptography.utils import int_from_bytes Nov 16 19:00:42.200614 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 19:00:42.201286 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 19:00:42.201383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 19:00:42.201764 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 19:00:42.202020 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 19:00:42.202411 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.202738 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.203060 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.203384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.203718 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.204031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.204356 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.204677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.205013 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.205271 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.205620 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.205943 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-667108-35-iscsi {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.206269 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.207049 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.207049 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.207270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.207573 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.207818 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.208126 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.208228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 19:00:42.208654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 19:00:42.208768 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.210052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 19:00:42.210052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 19:00:42.210254 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.210339 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 19:00:42.210423 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.210693 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.210804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.210886 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.210957 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211046 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211126 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211198 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211268 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211344 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211498 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211576 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.211881 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.212105 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.212331 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.212558 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.212779 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.212997 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-667108-35-iscsi {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.212997 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.213409 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.213719 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.213942 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.214163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.214382 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-667108-35-iscsi {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.214633 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.214852 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.215170 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.215405 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.215627 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.215836 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.216057 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.216267 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.216493 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.216703 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.216891 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.217115 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.217265 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.217454 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.217641 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.217641 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.217980 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.218145 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.218300 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.218495 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.218647 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.218793 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.218947 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.219092 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.219244 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.219400 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.219560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.219717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.219905 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.220056 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.221301 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.221483 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.221723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.221873 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.222029 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.222176 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.222330 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.222557 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.222719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-667108-35-iscsi {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.222866 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.223035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.223199 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.223199 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.223497 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.223653 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.223810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.223962 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.224118 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.224283 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.224440 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.224592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.224760 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.224915 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.225067 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.225213 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.225433 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.225634 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.225788 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.225949 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.226178 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.226374 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.226524 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.226677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.226836 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.227026 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.227189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.227391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.227619 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.227850 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.228030 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.228193 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.228340 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.228503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.228658 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.228804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.229013 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.229201 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.229361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.229515 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.229700 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.229848 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.230009 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.230155 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.230331 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.231519 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.231687 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.231834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.231991 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.232150 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.232321 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.232321 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.232615 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.232781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.232937 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.233084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.233239 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.233393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.233539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.233759 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.233907 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.234063 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.234228 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.234374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.234518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.234678 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.234834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.234988 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.235141 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.235298 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.235457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.235619 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.235817 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.237031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.237247 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.237421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.237712 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.237712 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.238020 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.238174 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.238321 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.238466 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.238620 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.238801 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.238957 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.239140 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.239297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.239457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.239613 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.239769 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.239916 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.240062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.240215 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.240371 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.240518 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.241174 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.241516 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.241914 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.242077 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.242240 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.242406 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.242555 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.242701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.242701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.242998 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.243145 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.243298 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.243445 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.244117 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.244275 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245117 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245434 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245509 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245702 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245870 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.245968 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246151 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246243 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246333 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246417 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246417 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246574 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246663 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246747 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246837 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.246920 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247010 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247094 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247176 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247257 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247339 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247529 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247611 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247693 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247867 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.247957 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248041 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248130 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248212 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248304 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248394 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248490 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248574 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248661 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248752 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248835 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.248917 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249392 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249563 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249655 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249741 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249830 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.249933 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.250018 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.250108 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.250190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.250279 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.250371 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.250456 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.250537 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.250619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.250708 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.250798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.250896 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.250980 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.251070 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.251154 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.251245 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.251345 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.251430 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.251512 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.251601 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.251685 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.251767 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.251862 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.251954 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.252037 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.252127 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.252127 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.252294 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.252379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.252462 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.252551 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.252640 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.252723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.252817 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.252902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.252983 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.253073 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.253163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.253252 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.253348 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.253432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.253521 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.257724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.257888 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.258057 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.258225 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.258387 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 19:00:42.258537 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.258692 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.258850 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.259004 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.259166 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.259917 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.260081 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.260229 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.260376 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.260532 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.260691 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.261124 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.261366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.262833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.263015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.263313 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.263478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.263641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.263790 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.263937 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.264083 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.264237 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.264399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.264555 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.264717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.264873 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.265020 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.265166 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.265325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.265481 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.265681 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.265839 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.265994 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.266205 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.266367 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.266513 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.266666 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.266821 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.266974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.267129 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.267284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.267438 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.267604 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.267751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.267896 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.268114 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.268262 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.268407 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.268561 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.268714 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.268870 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.269030 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.269178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.269331 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.269477 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.269681 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.269840 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.270000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.270158 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.270305 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.270451 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.270596 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.270596 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.270895 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.271049 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.271196 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.271196 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.271588 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.272163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.272399 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.272552 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.272699 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.273052 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.273214 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.273373 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.273522 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.273705 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.273853 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.274006 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.274152 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.274308 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.274466 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.274620 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.274774 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.274960 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.275119 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.275265 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.275422 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.275575 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.275722 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.275867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.276021 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.276176 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.276332 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.276478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.276623 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.276623 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.276924 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.276924 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.277217 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.277217 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.277500 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.277686 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.277848 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.278005 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.278152 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.278312 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.278466 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.278626 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.278784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.278938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.279091 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.279245 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.279391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.279546 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.279692 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.279836 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.279981 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.280125 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.280281 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.280437 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.280583 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.280729 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.280882 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.281038 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.281192 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.281192 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.281478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.281478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.282340 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.282340 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.282741 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.282909 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.283255 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.283412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.283570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.283723 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.283879 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.284026 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.284216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.284366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.284512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.284658 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.284818 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.284978 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.285124 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.285270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.285414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.285600 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.285770 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.285925 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.286081 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.286081 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.286366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.286523 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.286677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.286825 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.286981 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.287126 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.287271 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.287424 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.287578 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.287739 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.287893 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.288046 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.288192 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.288348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.288494 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.288639 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.288785 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.288940 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.289086 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.289245 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.289399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.289562 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.289729 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.289885 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.290090 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.290247 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.290394 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.290626 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.290784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.290930 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.291101 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.291256 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.291416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.291574 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.291748 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.291971 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.292482 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.292720 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.292884 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.293039 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.293205 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.293592 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.293766 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.293926 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.294072 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.294216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.294360 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.294520 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.294675 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.294830 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.294984 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.295129 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.295274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.295432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.295586 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.295732 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.295896 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.296045 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.296189 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.296343 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.296496 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.296649 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.296795 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.296940 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.297085 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.297243 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.297396 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.297557 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.297735 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.297883 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.298028 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.298189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.298334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.298488 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.298642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.298796 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.299021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.299171 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.299316 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.299468 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.299622 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.299787 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.299943 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.300089 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.300234 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.300379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.300532 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.300678 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.300832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.300980 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.301124 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.301287 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.301435 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.301626 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.301798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.302118 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.302639 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.302875 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.303037 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.303199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.303347 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.303686 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.303837 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.303992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.304239 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.304407 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.304555 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.304711 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.304857 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.305009 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.307183 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.307361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.307515 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.307673 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.307822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.308117 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.308286 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.308445 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.308594 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.308764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.308927 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.309083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.309239 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.309392 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.309538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.309733 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.309889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.310045 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.310199 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.310355 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.310500 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.310645 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.310811 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.310965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.311119 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.311266 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.311419 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.311584 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.311742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.311889 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.312034 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.312289 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.312887 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.313959 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.314143 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.314294 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.314441 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.314596 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.314743 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.314905 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.315061 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.315216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.315363 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.315509 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.315655 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.315810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.315957 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.316121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.316277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.316432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.316578 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.316739 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.316893 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.317049 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.317432 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.317660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.317829 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.317978 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.318124 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.318270 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.318409 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.318699 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.318845 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.318968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.318968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.319198 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.319319 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.319440 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.319551 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.319647 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.319734 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.319818 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.319943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320036 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320219 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320312 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320397 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320481 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320579 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320665 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320758 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320852 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.320939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321022 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321114 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321207 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321293 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321465 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321573 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.321826 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.322487 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.322652 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323029 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323151 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323251 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323338 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323433 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323517 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323601 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323694 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323998 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.323998 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324371 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324469 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324555 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324647 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324733 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324827 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.324922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325016 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325194 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325288 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325382 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325382 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325583 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325763 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325866 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.325954 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326039 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326122 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326205 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326287 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326287 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326450 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326543 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326628 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.326987 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327070 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327160 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327254 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327419 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327516 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327601 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327692 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327777 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.327917 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328058 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328157 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328244 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328336 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328431 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328525 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328617 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328711 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328803 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.328983 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329067 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329158 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329244 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329335 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329434 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329521 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329634 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329722 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329813 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.329906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330159 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330242 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330326 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330408 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330505 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330779 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330864 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.330962 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331055 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331151 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331236 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331320 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331415 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331604 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331695 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331780 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331863 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.331953 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332047 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332132 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332222 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332314 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332406 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332491 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332585 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332730 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.332835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.333128 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.333238 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.333337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.333441 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.333535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.333690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.333830 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.334051 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.334361 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.334468 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.334565 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.334660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.334754 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.334841 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.334935 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335022 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335106 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335282 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335367 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335462 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335556 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335650 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335736 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335828 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.335928 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336016 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336108 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336201 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336288 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336372 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336471 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336566 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336653 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336746 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336841 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.336928 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337022 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337109 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337193 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337391 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337481 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337593 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337683 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337779 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337879 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.337967 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338105 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338407 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338499 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338585 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338682 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338776 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.338953 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339039 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339130 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339235 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339322 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339407 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339490 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339573 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339768 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.339854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340202 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340382 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340475 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340561 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340748 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.340834 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.341713 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.341828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.341909 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.341990 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342076 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342149 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342220 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342289 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342359 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342586 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342664 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342735 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342921 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.342994 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343090 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343164 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343241 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343312 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343392 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343464 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343542 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343620 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343699 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343777 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343857 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343929 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.343998 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344067 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344143 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344221 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344382 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344474 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344557 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344635 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344796 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.344883 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345033 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345115 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345256 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345256 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345403 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345475 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345562 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345640 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345796 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345796 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345796 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.345995 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.346074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.346145 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.346214 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.346524 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.346628 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.347556 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.347648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.347648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.347795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.347880 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.347951 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.348027 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.348128 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.348284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.348368 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.348446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.348523 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.348593 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.348670 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.349756 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.349868 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.349868 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350017 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350089 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350157 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350233 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350312 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350390 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350460 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350529 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.350597 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.351452 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.351555 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.351636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.351708 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.351777 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.351845 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.351928 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.352008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.352086 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.352157 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353122 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353232 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353322 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353465 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353911 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.353996 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.354302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.354406 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.354686 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.354801 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.355018 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.355120 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.355329 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.355428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.355645 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.355743 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.355976 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.356072 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.356304 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.356431 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.356706 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.356803 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.356930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.357149 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.357356 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.357571 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.357999 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.358177 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.358334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.358495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.358652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.358805 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.358971 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.359193 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.359365 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.359522 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.359674 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.359837 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.359993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.360153 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.360319 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.360472 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.360472 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.360772 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.360927 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.361089 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.361244 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.361411 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.361656 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.361830 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.361986 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.362689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.362848 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.362993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.362993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.363294 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.363612 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.363774 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.364083 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.364240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.364376 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.364509 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.364641 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.364773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.364912 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.365209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.365355 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.365497 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.365660 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.365795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.365933 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.366076 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.366238 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.366387 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.366549 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.366740 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.366871 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.367003 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.367142 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.367284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.367426 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.367573 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.367715 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.367848 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.367987 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.368127 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.368259 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.368400 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.368534 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.369195 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.369331 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.369464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.369624 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.369761 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.369902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.369902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.370161 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.370317 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.371017 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.371168 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.371305 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.371446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.371590 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.371732 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.371878 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.372020 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.372154 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.372285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.372424 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.372558 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.372699 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.372832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.372964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.373108 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.373250 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.373250 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.373524 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.373843 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.374007 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.374303 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.374443 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.374589 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.374731 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.374873 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.375988 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.376137 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.376282 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.376432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.376566 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.376700 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.376832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.376963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.377093 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.377234 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.377375 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.377375 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.377719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.377868 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.378011 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.378152 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.378285 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.378417 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.378537 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.378648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.378792 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.378935 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.379068 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.379202 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.379323 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.379435 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.379561 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.379684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.379796 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.379916 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.380028 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.380190 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.380337 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.380520 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.380645 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.380765 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.380879 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.380999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.381111 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.381230 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.381349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.381461 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.381636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.381775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.381899 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.382070 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.382191 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.382311 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.382422 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.382552 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.382666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.382776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.382893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.383004 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.383137 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.383260 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.383380 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.383509 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.383651 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.383939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.384087 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.384960 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.385112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.385112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.385112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.385112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.385992 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.386120 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.386240 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.386361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.386480 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.386600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.386600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.386832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.386953 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.387246 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.387381 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.387506 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.387649 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.387783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.387922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.388054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.388054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.388314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.388456 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.388589 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.388722 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.388855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.388986 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.389131 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.389271 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.389414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.389592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.389741 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.389875 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.390017 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.390195 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.390331 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.390464 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.390605 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.390754 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.390888 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.391068 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.391206 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.391385 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.391523 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.391702 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.391842 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.392020 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.392156 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.392383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.392524 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.392698 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.392834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.393008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.393158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.393325 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.393474 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.393666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.393812 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.394119 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.394257 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.394388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.394617 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.394755 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.394895 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.395049 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.395275 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.395411 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.395641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.395779 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.395919 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.396051 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.396183 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.396321 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.396536 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.396672 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.396804 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.396935 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.397064 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.397211 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.397346 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.397478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.397623 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.397742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.397943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.398094 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.398269 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.398406 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.398600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.398820 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.398977 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.399141 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.399279 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.399478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.399624 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.399809 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.399982 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.400170 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.400313 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.400492 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.400628 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.400814 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.400951 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.401120 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.401262 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.401437 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.401640 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.401789 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.401922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.402074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.402204 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.402385 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.402519 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.402691 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.402834 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.403003 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.403137 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.403317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.403453 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.403624 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.403771 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.403932 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.404231 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.404231 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.404502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.404716 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.404861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.404996 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.405205 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.405447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.405730 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.405871 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.406004 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.406139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.406272 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.406404 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.406546 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.406680 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.406812 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.406944 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.407084 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.407227 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.407369 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.407541 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.407670 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.407868 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.408004 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.408251 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.408387 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.408527 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.408661 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.408793 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.408932 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.409074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.409208 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.409363 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.409501 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.409695 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.409833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.410011 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.410158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.410322 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.410460 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.410651 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.410798 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.410961 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.411100 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.411269 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.411415 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.411577 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.411726 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.411888 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.412032 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.412197 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.412341 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.412503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.412730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.412876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.413080 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.413226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.413401 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.413540 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.413727 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.413861 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.414031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.414323 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.414472 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.414633 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.414847 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.414977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.415098 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.415237 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.415359 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.416207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.416417 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.416535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.416648 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.416768 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.416889 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.417011 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.417132 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.417296 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.417418 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.417640 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.417765 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.417970 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.418095 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.418285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.418414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.418597 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.418733 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.418949 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.419070 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.419252 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.419381 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.419585 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.419797 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.419928 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.420184 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.420311 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.420491 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.420618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.420843 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.420982 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.421097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.421209 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.421391 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.421523 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.421728 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.421871 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.422032 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.422126 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.422386 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.422573 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.422712 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.422855 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.423012 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.423157 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.423325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.423475 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.423638 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.423788 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.423951 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.424089 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.424262 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.424562 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.424709 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.424866 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.424866 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.425218 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.425353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.425495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.425495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.425778 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.425928 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.426063 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.426384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.426520 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.426653 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.426784 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.426925 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.427059 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.427207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.427341 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.427455 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.427586 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.427717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.427848 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.427988 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.428248 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.428384 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.428581 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.428718 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.428929 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.429072 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.429197 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.429443 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.429645 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.429967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.430235 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.430374 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.430592 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.430728 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.430902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.431031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.431795 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.431938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.432109 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.432257 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.432425 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.432563 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.432748 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.432895 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.433043 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.433186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.433366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.433519 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.433735 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.433880 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.434069 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.434209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.434399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.434709 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.434850 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.434991 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.435203 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.435331 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.435455 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.435579 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.435721 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.435911 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.436226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.436531 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.436684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.436828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.436963 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.437080 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.437210 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.437342 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.437578 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.437708 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.437834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.437976 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.438125 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.438334 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.438473 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.438685 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.438832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.439007 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.439145 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.439339 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.439484 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.439651 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.439797 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.439943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.440076 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.440259 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.440396 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.440569 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.440716 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.440879 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.441017 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.441209 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.441347 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.441601 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.441742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.441867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.441990 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.442202 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.442310 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.442516 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.442622 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.442836 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.442955 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.443151 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.443252 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.443468 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.443638 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.443786 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.443943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.444682 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.444967 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.445111 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.445326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.445463 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.445633 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.445780 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.445923 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.446066 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.446201 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.446343 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.446499 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.447459 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.447612 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.447758 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.447897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.448041 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.448177 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.448177 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.448429 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.448570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.448711 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.448854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.448996 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.449132 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.449264 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.449397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.449539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.449730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.449865 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.450007 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.450153 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.450298 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.450446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.450446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116169) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 19:00:42.450752 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.450752 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.450752 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.450752 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.451271 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.451411 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.451672 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.452039 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.452349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.452623 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.452940 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.453261 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.453601 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.453913 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.454246 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.454559 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.455004 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.455186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.455500 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.455817 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.456133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.456464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.456798 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.457125 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.457583 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.457831 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.458146 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.458492 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.458825 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.459143 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.459455 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.459764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 19:00:42.460005 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 19:00:42.477926 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_db.sqlalchemy.engines [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 19:00:42.483055 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 19:00:42.637455 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.context [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad1d2f2-15e4-42bc-bf20-68092f43efab(cell1) {{(pid=116169) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 19:00:42.641762 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.context [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2ad1d2f2-15e4-42bc-bf20-68092f43efab(cell1) {{(pid=116168) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 19:00:42.642008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:00:42.643571 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:00:42.644404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:00:42.646243 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:00:42.646354 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:00:42.647812 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:00:42.648647 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:00:42.651914 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:00:42.659131 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_db.sqlalchemy.engines [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 19:00:42.662393 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_db.sqlalchemy.engines [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 19:00:42.662654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 19:00:42.669762 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 19:00:42.830729 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_db.sqlalchemy.engines [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116169) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 19:00:42.831740 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_db.sqlalchemy.engines [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 19:00:43.154254 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: WARNING keystonemiddleware.auth_token [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 19:00:43.156961 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: WARNING keystonemiddleware.auth_token [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 19:00:43.160684 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: WARNING keystonemiddleware.auth_token [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 19:00:43.163499 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: WARNING keystonemiddleware.auth_token [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 19:00:43.507880 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: WARNING keystonemiddleware.auth_token [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 19:00:43.516607 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: WARNING keystonemiddleware.auth_token [None req-8b674962-7ff9-4961-b2a8-6a117a093e99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 19:00:43.517708 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: WARNING keystonemiddleware.auth_token [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 19:00:43.522559 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eaaebf29c0 pid: 116169 (default app) Nov 16 19:00:43.523171 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: WARNING keystonemiddleware.auth_token [None req-1ec65784-0714-4488-9018-e8eb8eda5fbc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 19:00:43.528602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eaaebf29c0 pid: 116168 (default app) Nov 16 19:01:17.510215 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7fa31b93-acbb-469c-9db7-a82ece3fbbfe tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Action: 'create', calling method: .version_select at 0x7ffa5cc5bd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1604496536", "metadata": {"Type": "work"}}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:17.513713 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7fa31b93-acbb-469c-9db7-a82ece3fbbfe tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:17.525968 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7fa31b93-acbb-469c-9db7-a82ece3fbbfe tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.214797 Nov 16 19:01:17.527069 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 16 19:01:16 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 19:01:17.537836 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-000d5a0a-5959-4a2a-9c4c-5d5b86c277bd tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Action: 'create', calling method: .version_select at 0x7ffa5cbb98b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-161614270", "metadata": {"Type": "work"}}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:17.540868 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-000d5a0a-5959-4a2a-9c4c-5d5b86c277bd tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:17.541958 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-000d5a0a-5959-4a2a-9c4c-5d5b86c277bd tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008779 Nov 16 19:01:17.543177 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 2/2] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 16 19:01:17 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 19:01:17.552698 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-16327205-e72f-46ac-bbbe-7adac6f669e3 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Action: 'create', calling method: .version_select at 0x7ffa5cbb9a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-573443812", "metadata": {"Type": "work"}}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:17.554865 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-16327205-e72f-46ac-bbbe-7adac6f669e3 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:17.556006 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-16327205-e72f-46ac-bbbe-7adac6f669e3 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007719 Nov 16 19:01:17.557072 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 3/3] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 16 19:01:17 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 16 19:01:17.572284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b599731b-2d57-4d97-9990-58af8381d9b5 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Calling method '.version_select at 0x7ffa5cc01310>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:18.080945 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dbba1a12-796c-4d83-9e89-8e85f05d12ab tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Action: 'create', calling method: .version_select at 0x7ffa5cc5bd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1457176942"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:18.601564 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-b599731b-2d57-4d97-9990-58af8381d9b5 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] HTTP exception thrown: Volume tempest-invalid-422722304 could not be found. Nov 16 19:01:18.605003 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b599731b-2d57-4d97-9990-58af8381d9b5 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Returning 404 to user: Volume tempest-invalid-422722304 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:18.606257 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b599731b-2d57-4d97-9990-58af8381d9b5 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-422722304" status: 404 len: 98 microversion: 2.1 time: 1.042694 Nov 16 19:01:18.607834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 4/4] 10.222.0.46 () {58 vars in 1214 bytes} [Tue Nov 16 19:01:17 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-422722304 => generated 98 bytes in 1045 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 16 19:01:18.621316 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0241ffe5-96fc-441c-a9d0-812c840cc49b tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008140 Nov 16 19:01:18.622470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1139 bytes} [Tue Nov 16 19:01:18 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 16 19:01:18.634286 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a712b2b2-0ba2-4fc6-aa7d-1fa20dca99e6 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005848 Nov 16 19:01:18.636030 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1136 bytes} [Tue Nov 16 19:01:18 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 16 19:01:18.653952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7df37e8d-3842-4576-a8f5-033ff94ea179 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Calling method '.version_select at 0x7ffa5cabe940>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:18.713642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-7df37e8d-3842-4576-a8f5-033ff94ea179 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] HTTP exception thrown: Volume d5bd7ab4-9fc1-4b0a-900f-78646d89031b could not be found. Nov 16 19:01:18.714616 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7df37e8d-3842-4576-a8f5-033ff94ea179 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Returning 404 to user: Volume d5bd7ab4-9fc1-4b0a-900f-78646d89031b could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:18.716209 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7df37e8d-3842-4576-a8f5-033ff94ea179 tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/d5bd7ab4-9fc1-4b0a-900f-78646d89031b" status: 404 len: 109 microversion: 2.1 time: 0.073460 Nov 16 19:01:18.717481 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 7/7] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 19:01:18 2021] DELETE /compute/v2.1/os-volumes/d5bd7ab4-9fc1-4b0a-900f-78646d89031b => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:01:18.727625 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4602efa3-1531-480c-85d3-166b2ecc178c tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Calling method '.version_select at 0x7ffa5cabe700>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:18.769479 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-4602efa3-1531-480c-85d3-166b2ecc178c tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] HTTP exception thrown: Volume a6327389-6ba8-4d46-84d1-c5911e658e59 could not be found. Nov 16 19:01:18.770652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4602efa3-1531-480c-85d3-166b2ecc178c tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] Returning 404 to user: Volume a6327389-6ba8-4d46-84d1-c5911e658e59 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:18.772332 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4602efa3-1531-480c-85d3-166b2ecc178c tempest-VolumesNegativeTest-1289792559 tempest-VolumesNegativeTest-1289792559-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/a6327389-6ba8-4d46-84d1-c5911e658e59" status: 404 len: 109 microversion: 2.1 time: 0.049623 Nov 16 19:01:18.773334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 8/8] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:01:18 2021] GET /compute/v2.1/os-volumes/a6327389-6ba8-4d46-84d1-c5911e658e59 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:01:20.180224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1051607137", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "8fbdbf4b-a203-4c7d-88fd-6c6366312a01"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:20.461727 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] validate_networks() for [('8fbdbf4b-a203-4c7d-88fd-6c6366312a01', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:01:20.719356 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dbba1a12-796c-4d83-9e89-8e85f05d12ab tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.895550 Nov 16 19:01:20.721210 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 1/9] 10.222.0.46 () {60 vars in 1154 bytes} [Tue Nov 16 19:01:16 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3899 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 16 19:01:20.733821 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e34ba0b6-0591-49e5-82bf-d1babda53a09 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5caac8b0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:20.903563 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e34ba0b6-0591-49e5-82bf-d1babda53a09 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622" status: 200 len: 345 microversion: 2.1 time: 0.174126 Nov 16 19:01:20.904285 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 2/10] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:01:20 2021] GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622 => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:01:21.926137 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7caa3d4b-42b5-4b19-8483-99f07394c601 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5caacf70>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:22.038972 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7caa3d4b-42b5-4b19-8483-99f07394c601 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622" status: 200 len: 346 microversion: 2.1 time: 0.123890 Nov 16 19:01:22.039824 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 3/11] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:01:21 2021] GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622 => generated 346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:22.051436 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-28d6297d-4c70-46c5-a8bd-bd6025b55672 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Action: 'create', calling method: .version_select at 0x7ffa5cabd280>, body: {"snapshot": {"volume_id": "7b5589c2-d9d1-4bb8-b6c0-20951553e622", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-411465840"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:22.333450 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:01:22.335082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:01:22.335786 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:01:22.336663 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:01:22.337660 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:01:22.361058 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:22.362318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:22.365172 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:22.366217 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:22.424836 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Getting quotas for project eb8ecf530f404e9588c2db9f9a4ba148. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:01:22.433692 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Getting quotas for user 46ac557e7ae54b73840960ef2b56b871 and project eb8ecf530f404e9588c2db9f9a4ba148. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:01:22.478556 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:01:22.485473 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:01:22.545031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-28d6297d-4c70-46c5-a8bd-bd6025b55672 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.497578 Nov 16 19:01:22.545981 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 4/12] 10.222.0.46 () {60 vars in 1161 bytes} [Tue Nov 16 19:01:22 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:01:22.556732 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5b5e4be6-9a2d-4979-a129-121346f0fce3 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5cabde50>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:22.632804 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5b5e4be6-9a2d-4979-a129-121346f0fce3 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 200 len: 286 microversion: 2.1 time: 0.080853 Nov 16 19:01:22.634219 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 5/13] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:22 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:01:22.647349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-57cd749c-7d7c-4b54-b92d-33d3a228aaed tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5cabdd30>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:22.740195 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-57cd749c-7d7c-4b54-b92d-33d3a228aaed tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.099435 Nov 16 19:01:22.741270 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 6/14] 10.222.0.46 () {58 vars in 1139 bytes} [Tue Nov 16 19:01:22 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:01:22.753985 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-35fe3bca-953f-41f4-971d-66d6adb321a8 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5caace50>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:22.754542 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-66254fab-d89a-48de-a77a-28dbafbc57ec tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.098735 Nov 16 19:01:22.757845 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 9/15] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:01:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 3105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:01:22.768807 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-eee9ceca-3a33-4f58-b100-48457af13342 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:22.769806 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-eee9ceca-3a33-4f58-b100-48457af13342 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:22.843844 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-35fe3bca-953f-41f4-971d-66d6adb321a8 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 200 len: 286 microversion: 2.1 time: 0.095362 Nov 16 19:01:22.848228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 7/16] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:22 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:01:22.947621 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-eee9ceca-3a33-4f58-b100-48457af13342 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:23.009772 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-eee9ceca-3a33-4f58-b100-48457af13342 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1215 microversion: 2.1 time: 0.244950 Nov 16 19:01:23.032959 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 10/17] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:22 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1215 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:23.859976 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6f6f6ec0-e302-426c-8d67-ea2bcb374594 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5cacb1f0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:23.933785 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6f6f6ec0-e302-426c-8d67-ea2bcb374594 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 200 len: 286 microversion: 2.1 time: 0.077718 Nov 16 19:01:23.935341 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 8/18] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:23 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:24.031643 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-70e0caec-2427-4078-b5f8-9309cbf45d6a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:24.032413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-70e0caec-2427-4078-b5f8-9309cbf45d6a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:24.392710 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-70e0caec-2427-4078-b5f8-9309cbf45d6a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:24.416049 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-70e0caec-2427-4078-b5f8-9309cbf45d6a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1215 microversion: 2.1 time: 0.389023 Nov 16 19:01:24.429328 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 11/19] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:24 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1215 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:24.949099 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8e99dd20-ebd2-4d88-b9a6-c17bbab9624b tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5caacd30>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:25.035187 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8e99dd20-ebd2-4d88-b9a6-c17bbab9624b tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 200 len: 286 microversion: 2.1 time: 0.092484 Nov 16 19:01:25.039496 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 9/20] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:24 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:25.439850 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c1a96a61-fde8-43f3-9fce-571fb2c2b012 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:25.442570 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c1a96a61-fde8-43f3-9fce-571fb2c2b012 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:25.468892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c1a96a61-fde8-43f3-9fce-571fb2c2b012 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:25.469760 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c1a96a61-fde8-43f3-9fce-571fb2c2b012 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:25.470782 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c1a96a61-fde8-43f3-9fce-571fb2c2b012 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:25.471487 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c1a96a61-fde8-43f3-9fce-571fb2c2b012 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:25.875896 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c1a96a61-fde8-43f3-9fce-571fb2c2b012 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:25.911001 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c1a96a61-fde8-43f3-9fce-571fb2c2b012 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1219 microversion: 2.1 time: 0.478099 Nov 16 19:01:25.911552 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 12/21] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:25 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1219 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:26.063669 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-521c529b-3d94-4038-ba44-fa9773c3a4cb tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c0f0940>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:26.146181 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-521c529b-3d94-4038-ba44-fa9773c3a4cb tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 200 len: 287 microversion: 2.1 time: 0.103134 Nov 16 19:01:26.146973 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 13/22] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:26 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:01:26.157619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-daf87d79-e7ab-45e3-8846-0105a502db04 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c1073a0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:26.166986 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e3a2ccd7-da06-42aa-87a3-01291292ea13 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'create', calling method: .version_select at 0x7ffa5caacf70>, body: {"keypair": {"name": "tempest-keypair-1135324023"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:26.357378 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-daf87d79-e7ab-45e3-8846-0105a502db04 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 202 len: 0 microversion: 2.1 time: 0.203714 Nov 16 19:01:26.358874 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 14/23] 10.222.0.46 () {58 vars in 1253 bytes} [Tue Nov 16 19:01:26 2021] DELETE /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:01:26.372455 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-953034ee-0dff-49b5-9c99-301804e023ab tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c107310>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:26.395097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-e3a2ccd7-da06-42aa-87a3-01291292ea13 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for project 836db18eadf842ce90dda0a1221006ff. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:01:26.412841 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-e3a2ccd7-da06-42aa-87a3-01291292ea13 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for user 047420b1d0b84633af129ecb0ac468ab and project 836db18eadf842ce90dda0a1221006ff. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:01:26.618794 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-953034ee-0dff-49b5-9c99-301804e023ab tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 200 len: 286 microversion: 2.1 time: 0.251351 Nov 16 19:01:26.619905 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 15/24] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:26 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:26.800250 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-e3a2ccd7-da06-42aa-87a3-01291292ea13 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for project 836db18eadf842ce90dda0a1221006ff. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:01:26.816810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-e3a2ccd7-da06-42aa-87a3-01291292ea13 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for user 047420b1d0b84633af129ecb0ac468ab and project 836db18eadf842ce90dda0a1221006ff. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:01:26.849828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e3a2ccd7-da06-42aa-87a3-01291292ea13 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.081494 Nov 16 19:01:26.851069 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 10/25] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 19:01:25 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:26.929776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f8c518fb-00d7-4603-9b97-ba4931fd951e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:26.930574 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f8c518fb-00d7-4603-9b97-ba4931fd951e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:26.937391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f8c518fb-00d7-4603-9b97-ba4931fd951e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:26.938040 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f8c518fb-00d7-4603-9b97-ba4931fd951e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:26.939133 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f8c518fb-00d7-4603-9b97-ba4931fd951e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:26.939690 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f8c518fb-00d7-4603-9b97-ba4931fd951e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:27.284544 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f8c518fb-00d7-4603-9b97-ba4931fd951e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:27.292438 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f8c518fb-00d7-4603-9b97-ba4931fd951e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1211 microversion: 2.1 time: 0.367852 Nov 16 19:01:27.295557 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 16/26] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:26 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1211 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:27.631080 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-655442b6-7f9f-4561-a942-980d277832be tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5ca97700>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:27.684483 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-655442b6-7f9f-4561-a942-980d277832be tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 200 len: 286 microversion: 2.1 time: 0.057701 Nov 16 19:01:27.689268 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 11/27] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:27 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:01:28.320284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-05611c6a-c13f-41df-98b3-11af06b68434 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:28.321775 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-05611c6a-c13f-41df-98b3-11af06b68434 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:28.366287 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05611c6a-c13f-41df-98b3-11af06b68434 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:28.406084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05611c6a-c13f-41df-98b3-11af06b68434 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:28.406084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05611c6a-c13f-41df-98b3-11af06b68434 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:28.406084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05611c6a-c13f-41df-98b3-11af06b68434 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:28.410787 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-425178853", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "533462df-d675-4deb-a3d3-4fecaa48192e"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:28.549115 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] validate_networks() for [('533462df-d675-4deb-a3d3-4fecaa48192e', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:01:28.818876 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-05611c6a-c13f-41df-98b3-11af06b68434 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:28.860051 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-05611c6a-c13f-41df-98b3-11af06b68434 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1211 microversion: 2.1 time: 0.540422 Nov 16 19:01:28.860709 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 12/28] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:28 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1211 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:28.875437 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1cd3f78a-2017-4f22-9147-64edd34f79a9 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c171940>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:28.930569 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1cd3f78a-2017-4f22-9147-64edd34f79a9 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 200 len: 286 microversion: 2.1 time: 0.064315 Nov 16 19:01:28.931435 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 13/29] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:28 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:29.881185 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-241ee5f3-c423-4591-82ca-c59843b82fbb tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:29.886511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-241ee5f3-c423-4591-82ca-c59843b82fbb tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:29.903447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-241ee5f3-c423-4591-82ca-c59843b82fbb tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:29.913092 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-241ee5f3-c423-4591-82ca-c59843b82fbb tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:29.915759 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-241ee5f3-c423-4591-82ca-c59843b82fbb tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:29.923252 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-241ee5f3-c423-4591-82ca-c59843b82fbb tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:30.099873 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:01:30.100396 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:01:30.100952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:01:30.101822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:01:30.102338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:01:30.118431 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:30.125516 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:30.135106 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:30.141252 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:30.218963 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Getting quotas for project 88aad57826ba44d19a4a8c55a7eaea31. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:01:30.230852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Getting quotas for user 1bbf275ba14242c49598b3bd809b51d1 and project 88aad57826ba44d19a4a8c55a7eaea31. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:01:30.259310 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:01:30.269355 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:01:30.442337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d4b16fba-d2da-4cdd-9654-937b1fcc902a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.324608 Nov 16 19:01:30.452232 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 17/30] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:01:28 2021] POST /compute/v2.1/servers => generated 383 bytes in 2335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:01:30.464607 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c8a112da-713d-473e-830a-7625b1a66c6b tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c107550>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:30.513276 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-241ee5f3-c423-4591-82ca-c59843b82fbb tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:30.526927 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-241ee5f3-c423-4591-82ca-c59843b82fbb tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1275 microversion: 2.1 time: 0.649233 Nov 16 19:01:30.528983 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 14/31] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:29 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1275 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:30.545394 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-c8a112da-713d-473e-830a-7625b1a66c6b tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] HTTP exception thrown: Snapshot 0f7e315d-6b14-4932-951c-9273ecf49abd could not be found. Nov 16 19:01:30.546269 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9349e648-39ac-4514-b03c-9a58a7bf4915 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:30.547114 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c8a112da-713d-473e-830a-7625b1a66c6b tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Returning 404 to user: Snapshot 0f7e315d-6b14-4932-951c-9273ecf49abd could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:30.548185 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c8a112da-713d-473e-830a-7625b1a66c6b tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd" status: 404 len: 111 microversion: 2.1 time: 0.091963 Nov 16 19:01:30.551877 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 18/32] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:01:30 2021] GET /compute/v2.1/os-snapshots/0f7e315d-6b14-4932-951c-9273ecf49abd => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:01:30.554953 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9349e648-39ac-4514-b03c-9a58a7bf4915 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:30.566388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d528f519-8202-4901-a9d8-3844b417e75d tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c0f0430>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:30.789798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d528f519-8202-4901-a9d8-3844b417e75d tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622" status: 202 len: 0 microversion: 2.1 time: 0.229801 Nov 16 19:01:30.790508 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 19/33] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 19:01:30 2021] DELETE /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:01:30.799007 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7ce78f93-5c7f-45ad-85f0-82623a7f164c tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c107550>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:31.013593 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7ce78f93-5c7f-45ad-85f0-82623a7f164c tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622" status: 200 len: 345 microversion: 2.1 time: 0.218007 Nov 16 19:01:31.015202 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 20/34] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:01:30 2021] GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622 => generated 345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:31.147444 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9349e648-39ac-4514-b03c-9a58a7bf4915 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:31.215727 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9349e648-39ac-4514-b03c-9a58a7bf4915 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1221 microversion: 2.1 time: 0.673202 Nov 16 19:01:31.218389 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 15/35] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:30 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1221 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:31.515386 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1074893213", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88bf2e43-28ce-4261-97c8-fd704bf50e7b"}], "security_groups": [{"name": "tempest-securitygroup--802152343"}], "key_name": "tempest-keypair-1135324023", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:31.545846 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-63f44616-e9bd-4b81-8977-a5e3e89eafa8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:31.546559 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-63f44616-e9bd-4b81-8977-a5e3e89eafa8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:31.567123 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-63f44616-e9bd-4b81-8977-a5e3e89eafa8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:31.569309 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-63f44616-e9bd-4b81-8977-a5e3e89eafa8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:31.576334 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-63f44616-e9bd-4b81-8977-a5e3e89eafa8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:31.577742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-63f44616-e9bd-4b81-8977-a5e3e89eafa8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:31.861482 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-63f44616-e9bd-4b81-8977-a5e3e89eafa8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:31.872042 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-63f44616-e9bd-4b81-8977-a5e3e89eafa8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1273 microversion: 2.1 time: 0.331458 Nov 16 19:01:31.895482 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 16/36] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:31 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1273 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:31.916820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-994308710", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "533462df-d675-4deb-a3d3-4fecaa48192e"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:31.955472 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] validate_networks() for [('88bf2e43-28ce-4261-97c8-fd704bf50e7b', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:01:32.113779 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] validate_networks() for [('533462df-d675-4deb-a3d3-4fecaa48192e', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:01:33.024800 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:01:33.025411 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:01:33.025841 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:01:33.026220 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:01:33.026804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:01:33.054648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:33.059313 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:33.063097 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:33.063830 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:33.152975 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for project 836db18eadf842ce90dda0a1221006ff. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:01:33.165521 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for user 047420b1d0b84633af129ecb0ac468ab and project 836db18eadf842ce90dda0a1221006ff. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:01:33.224136 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:01:33.233095 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:01:33.417859 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9a065df4-4ade-427c-8ad0-edc19c8d0bcc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.894048 Nov 16 19:01:33.420831 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 21/37] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:01:31 2021] POST /compute/v2.1/servers => generated 401 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:01:33.431454 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-41a1bfe4-df03-4a67-b820-57528f15c9b1 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c0fb3a0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:33.664229 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-41a1bfe4-df03-4a67-b820-57528f15c9b1 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] HTTP exception thrown: Volume 7b5589c2-d9d1-4bb8-b6c0-20951553e622 could not be found. Nov 16 19:01:33.665054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-41a1bfe4-df03-4a67-b820-57528f15c9b1 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Returning 404 to user: Volume 7b5589c2-d9d1-4bb8-b6c0-20951553e622 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:33.666078 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-41a1bfe4-df03-4a67-b820-57528f15c9b1 tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622" status: 404 len: 109 microversion: 2.1 time: 0.244129 Nov 16 19:01:33.666784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 22/38] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:01:33 2021] GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622 => generated 109 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:01:33.682214 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d9a8b3c4-40d3-4c3d-9dc5-c7f2be5cfd5e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:33.686167 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d9a8b3c4-40d3-4c3d-9dc5-c7f2be5cfd5e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:33.719927 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d9a8b3c4-40d3-4c3d-9dc5-c7f2be5cfd5e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:33.720388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d9a8b3c4-40d3-4c3d-9dc5-c7f2be5cfd5e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:33.721188 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d9a8b3c4-40d3-4c3d-9dc5-c7f2be5cfd5e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:33.721654 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d9a8b3c4-40d3-4c3d-9dc5-c7f2be5cfd5e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:34.825870 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d9a8b3c4-40d3-4c3d-9dc5-c7f2be5cfd5e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:34.842889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d9a8b3c4-40d3-4c3d-9dc5-c7f2be5cfd5e tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 1.165550 Nov 16 19:01:34.852371 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 23/39] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:33 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:34.873112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9a0f6cff-de8a-4eb2-a24e-acb2d3419796 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:34.875073 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9a0f6cff-de8a-4eb2-a24e-acb2d3419796 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:34.903802 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a0f6cff-de8a-4eb2-a24e-acb2d3419796 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:34.906311 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a0f6cff-de8a-4eb2-a24e-acb2d3419796 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:34.907308 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a0f6cff-de8a-4eb2-a24e-acb2d3419796 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:34.908818 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a0f6cff-de8a-4eb2-a24e-acb2d3419796 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:35.013534 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9a0f6cff-de8a-4eb2-a24e-acb2d3419796 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:35.027314 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9a0f6cff-de8a-4eb2-a24e-acb2d3419796 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1242 microversion: 2.1 time: 0.182622 Nov 16 19:01:35.030221 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 24/40] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:34 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1242 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:35.040324 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-735b3716-5369-4b8e-af8e-6b23f6e809dc tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c0f03a0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:35.103999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-735b3716-5369-4b8e-af8e-6b23f6e809dc tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] HTTP exception thrown: Volume 7b5589c2-d9d1-4bb8-b6c0-20951553e622 could not be found. Nov 16 19:01:35.104727 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-735b3716-5369-4b8e-af8e-6b23f6e809dc tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Returning 404 to user: Volume 7b5589c2-d9d1-4bb8-b6c0-20951553e622 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:35.108941 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-735b3716-5369-4b8e-af8e-6b23f6e809dc tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622" status: 404 len: 109 microversion: 2.1 time: 0.076429 Nov 16 19:01:35.109781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 25/41] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 19:01:35 2021] DELETE /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:01:35.119372 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a128e624-18ac-442e-8cc1-8a980950906e tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Calling method '.version_select at 0x7ffa5c0724c0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:35.256784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-a128e624-18ac-442e-8cc1-8a980950906e tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] HTTP exception thrown: Volume 7b5589c2-d9d1-4bb8-b6c0-20951553e622 could not be found. Nov 16 19:01:35.260015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a128e624-18ac-442e-8cc1-8a980950906e tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] Returning 404 to user: Volume 7b5589c2-d9d1-4bb8-b6c0-20951553e622 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:01:35.262071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a128e624-18ac-442e-8cc1-8a980950906e tempest-VolumesSnapshotsTestJSON-437007224 tempest-VolumesSnapshotsTestJSON-437007224-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622" status: 404 len: 109 microversion: 2.1 time: 0.148439 Nov 16 19:01:35.263823 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 26/42] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:01:35 2021] GET /compute/v2.1/os-volumes/7b5589c2-d9d1-4bb8-b6c0-20951553e622 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:01:35.691399 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:01:35.692005 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:01:35.692279 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:01:35.692704 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:01:35.693133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:01:35.720761 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:35.722861 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:35.729303 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:35.731279 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:35.815326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Getting quotas for project 88aad57826ba44d19a4a8c55a7eaea31. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:01:35.840230 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Getting quotas for user 1bbf275ba14242c49598b3bd809b51d1 and project 88aad57826ba44d19a4a8c55a7eaea31. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:01:35.864849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-50fd38f6-4cbe-49df-b200-8be446d46a3b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:35.867608 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-50fd38f6-4cbe-49df-b200-8be446d46a3b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:35.895543 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-50fd38f6-4cbe-49df-b200-8be446d46a3b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:35.897326 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-50fd38f6-4cbe-49df-b200-8be446d46a3b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:35.905821 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-50fd38f6-4cbe-49df-b200-8be446d46a3b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:35.909008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-50fd38f6-4cbe-49df-b200-8be446d46a3b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:35.927582 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:01:35.947422 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:01:36.374364 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-256d1e7d-b3ee-4537-a416-26bf40f5911e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.474764 Nov 16 19:01:36.375511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 17/43] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:01:31 2021] POST /compute/v2.1/servers => generated 383 bytes in 4479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:01:36.392653 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4e1518ac-61ca-439b-aa0a-90d47b7cdfe4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:36.395638 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4e1518ac-61ca-439b-aa0a-90d47b7cdfe4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:36.421393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e1518ac-61ca-439b-aa0a-90d47b7cdfe4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:36.422171 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e1518ac-61ca-439b-aa0a-90d47b7cdfe4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:36.426051 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e1518ac-61ca-439b-aa0a-90d47b7cdfe4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:36.442619 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e1518ac-61ca-439b-aa0a-90d47b7cdfe4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:36.717152 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4e1518ac-61ca-439b-aa0a-90d47b7cdfe4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:36.725936 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4e1518ac-61ca-439b-aa0a-90d47b7cdfe4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1290 microversion: 2.1 time: 0.348848 Nov 16 19:01:36.732436 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 18/44] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:36 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1290 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:36.751413 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1724420d-402a-4e5a-85bc-c433f22f182a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:36.759180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1724420d-402a-4e5a-85bc-c433f22f182a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:37.153655 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1724420d-402a-4e5a-85bc-c433f22f182a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:37.160918 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1724420d-402a-4e5a-85bc-c433f22f182a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1221 microversion: 2.1 time: 0.427642 Nov 16 19:01:37.165296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 19/45] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:36 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1221 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:37.316414 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-50fd38f6-4cbe-49df-b200-8be446d46a3b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:37.331362 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-50fd38f6-4cbe-49df-b200-8be446d46a3b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 1.468366 Nov 16 19:01:37.337005 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 27/46] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:35 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:37.752126 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2f78f7a3-2b4d-40b1-ba12-5499fbdad424 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:37.760519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2f78f7a3-2b4d-40b1-ba12-5499fbdad424 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:37.771590 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f78f7a3-2b4d-40b1-ba12-5499fbdad424 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:37.774820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f78f7a3-2b4d-40b1-ba12-5499fbdad424 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:37.780630 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f78f7a3-2b4d-40b1-ba12-5499fbdad424 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:37.781241 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f78f7a3-2b4d-40b1-ba12-5499fbdad424 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:38.030067 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2f78f7a3-2b4d-40b1-ba12-5499fbdad424 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:38.046305 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2f78f7a3-2b4d-40b1-ba12-5499fbdad424 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1296 microversion: 2.1 time: 0.299909 Nov 16 19:01:38.050990 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 20/47] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:37 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1296 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:38.182373 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c3953b9b-946d-401a-9870-eb6798132358 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:38.183353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c3953b9b-946d-401a-9870-eb6798132358 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:38.192106 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c3953b9b-946d-401a-9870-eb6798132358 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:38.195507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c3953b9b-946d-401a-9870-eb6798132358 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:38.196416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c3953b9b-946d-401a-9870-eb6798132358 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:38.196905 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c3953b9b-946d-401a-9870-eb6798132358 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:38.362197 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a91eea48-bbac-4e90-a3e3-2a3e1b207dc3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:38.363085 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a91eea48-bbac-4e90-a3e3-2a3e1b207dc3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:38.378077 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a91eea48-bbac-4e90-a3e3-2a3e1b207dc3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:38.381296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a91eea48-bbac-4e90-a3e3-2a3e1b207dc3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:38.383577 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a91eea48-bbac-4e90-a3e3-2a3e1b207dc3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:38.384279 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a91eea48-bbac-4e90-a3e3-2a3e1b207dc3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:38.473522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c3953b9b-946d-401a-9870-eb6798132358 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:38.490630 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c3953b9b-946d-401a-9870-eb6798132358 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1273 microversion: 2.1 time: 0.315556 Nov 16 19:01:38.495447 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 28/48] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:38 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1273 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:39.077524 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a91eea48-bbac-4e90-a3e3-2a3e1b207dc3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:39.092299 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a91eea48-bbac-4e90-a3e3-2a3e1b207dc3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.741263 Nov 16 19:01:39.107048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 21/49] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:38 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:39.114397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-da3a3d37-469e-4123-b7a3-f7e9a9332547 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:39.116342 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-da3a3d37-469e-4123-b7a3-f7e9a9332547 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:39.133632 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-da3a3d37-469e-4123-b7a3-f7e9a9332547 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:39.134419 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-da3a3d37-469e-4123-b7a3-f7e9a9332547 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:39.136045 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-da3a3d37-469e-4123-b7a3-f7e9a9332547 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:39.137077 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-da3a3d37-469e-4123-b7a3-f7e9a9332547 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:39.325559 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-da3a3d37-469e-4123-b7a3-f7e9a9332547 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:39.342375 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-da3a3d37-469e-4123-b7a3-f7e9a9332547 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1296 microversion: 2.1 time: 0.231496 Nov 16 19:01:39.345854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 22/50] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:39 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1296 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:39.514679 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-98ac53e4-f697-4bd8-8371-c79e93e85c61 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:39.516329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-98ac53e4-f697-4bd8-8371-c79e93e85c61 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:39.540683 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98ac53e4-f697-4bd8-8371-c79e93e85c61 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:39.542938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98ac53e4-f697-4bd8-8371-c79e93e85c61 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:39.544844 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98ac53e4-f697-4bd8-8371-c79e93e85c61 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:39.545503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98ac53e4-f697-4bd8-8371-c79e93e85c61 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:39.710352 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-d8d13131-cecd-4184-9025-e26145d3dc83 req-227b89c7-c0c7-442b-9815-79db8f19b314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8df9df9-abb5-47f5-ba35-590c9d13ef80", "tag": "80c2bad8-ab54-4cb0-8aa8-cb0d47a28f5d"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:39.713274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:01:39.713274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:01:39.749479 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-d8d13131-cecd-4184-9025-e26145d3dc83 req-227b89c7-c0c7-442b-9815-79db8f19b314 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:39.751614 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-d8d13131-cecd-4184-9025-e26145d3dc83 req-227b89c7-c0c7-442b-9815-79db8f19b314 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:39.785586 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-98ac53e4-f697-4bd8-8371-c79e93e85c61 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:39.799019 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-98ac53e4-f697-4bd8-8371-c79e93e85c61 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1273 microversion: 2.1 time: 0.287866 Nov 16 19:01:39.801964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 23/51] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:39 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:39.827375 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-d8d13131-cecd-4184-9025-e26145d3dc83 req-227b89c7-c0c7-442b-9815-79db8f19b314 service nova] Creating event network-changed:80c2bad8-ab54-4cb0-8aa8-cb0d47a28f5d for instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 on hv-cinder-66710 Nov 16 19:01:39.830701 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-d8d13131-cecd-4184-9025-e26145d3dc83 req-227b89c7-c0c7-442b-9815-79db8f19b314 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116169) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 16 19:01:39.832450 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a3377b6c-1699-42bc-8d9a-fc62cb8fbeda None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:39.835810 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a3377b6c-1699-42bc-8d9a-fc62cb8fbeda None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:39.837449 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a3377b6c-1699-42bc-8d9a-fc62cb8fbeda None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:39.838378 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a3377b6c-1699-42bc-8d9a-fc62cb8fbeda None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:39.853995 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.compute.rpcapi [None req-a3377b6c-1699-42bc-8d9a-fc62cb8fbeda None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 16 19:01:39.855158 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a3377b6c-1699-42bc-8d9a-fc62cb8fbeda None None] Releasing lock "compute-rpcapi-router" {{(pid=116169) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 16 19:01:39.897082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a3377b6c-1699-42bc-8d9a-fc62cb8fbeda None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.895426 Nov 16 19:01:39.898711 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 29/52] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:01:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:01:40.108915 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-61da3d69-0943-4ff9-8de1-e284abc03f7a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:40.110241 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-61da3d69-0943-4ff9-8de1-e284abc03f7a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:40.119675 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61da3d69-0943-4ff9-8de1-e284abc03f7a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:40.120565 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61da3d69-0943-4ff9-8de1-e284abc03f7a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:40.121366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61da3d69-0943-4ff9-8de1-e284abc03f7a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:40.121827 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61da3d69-0943-4ff9-8de1-e284abc03f7a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:40.364108 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e06dc84c-bbb2-4c73-83a9-2a2ed68ef018 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:40.365831 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e06dc84c-bbb2-4c73-83a9-2a2ed68ef018 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:40.383872 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e06dc84c-bbb2-4c73-83a9-2a2ed68ef018 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:40.384881 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e06dc84c-bbb2-4c73-83a9-2a2ed68ef018 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:40.386187 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e06dc84c-bbb2-4c73-83a9-2a2ed68ef018 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:40.392777 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e06dc84c-bbb2-4c73-83a9-2a2ed68ef018 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:41.051078 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e06dc84c-bbb2-4c73-83a9-2a2ed68ef018 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:41.061683 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e06dc84c-bbb2-4c73-83a9-2a2ed68ef018 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1296 microversion: 2.1 time: 0.703725 Nov 16 19:01:41.065153 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 30/53] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:40 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1296 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:41.073899 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f33ce6af-5644-4efe-b58e-1b59f6457c7f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:41.076395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f33ce6af-5644-4efe-b58e-1b59f6457c7f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:41.120967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f33ce6af-5644-4efe-b58e-1b59f6457c7f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:41.121509 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f33ce6af-5644-4efe-b58e-1b59f6457c7f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:41.134896 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f33ce6af-5644-4efe-b58e-1b59f6457c7f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:41.135693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f33ce6af-5644-4efe-b58e-1b59f6457c7f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:41.764499 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-61da3d69-0943-4ff9-8de1-e284abc03f7a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:41.781881 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-61da3d69-0943-4ff9-8de1-e284abc03f7a tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 1.671952 Nov 16 19:01:41.783934 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 24/54] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:40 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:41.880308 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f33ce6af-5644-4efe-b58e-1b59f6457c7f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:41.900492 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f33ce6af-5644-4efe-b58e-1b59f6457c7f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1279 microversion: 2.1 time: 0.834020 Nov 16 19:01:41.901712 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 31/55] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:41 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1279 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:42.080157 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8dd86c6f-121e-4c73-82d0-fc7ac247dcd3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:42.081238 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8dd86c6f-121e-4c73-82d0-fc7ac247dcd3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:42.094912 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8dd86c6f-121e-4c73-82d0-fc7ac247dcd3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:42.095477 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8dd86c6f-121e-4c73-82d0-fc7ac247dcd3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:42.096374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8dd86c6f-121e-4c73-82d0-fc7ac247dcd3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:42.099358 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8dd86c6f-121e-4c73-82d0-fc7ac247dcd3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:42.549669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8dd86c6f-121e-4c73-82d0-fc7ac247dcd3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:42.563121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8dd86c6f-121e-4c73-82d0-fc7ac247dcd3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.487130 Nov 16 19:01:42.565048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 25/56] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:42 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:42.800760 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b9a294a7-b116-4605-a6d0-67c543f3ba90 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:42.802892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b9a294a7-b116-4605-a6d0-67c543f3ba90 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:42.814081 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b9a294a7-b116-4605-a6d0-67c543f3ba90 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:42.814858 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b9a294a7-b116-4605-a6d0-67c543f3ba90 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:42.817617 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b9a294a7-b116-4605-a6d0-67c543f3ba90 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:42.818067 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b9a294a7-b116-4605-a6d0-67c543f3ba90 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:42.922479 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-af674a7b-7190-45ce-8016-7b1cfff08364 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:42.923105 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-af674a7b-7190-45ce-8016-7b1cfff08364 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:42.943870 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af674a7b-7190-45ce-8016-7b1cfff08364 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:42.946229 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af674a7b-7190-45ce-8016-7b1cfff08364 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:42.947620 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af674a7b-7190-45ce-8016-7b1cfff08364 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:42.950495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af674a7b-7190-45ce-8016-7b1cfff08364 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:43.291611 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-af674a7b-7190-45ce-8016-7b1cfff08364 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:43.316677 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-af674a7b-7190-45ce-8016-7b1cfff08364 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1279 microversion: 2.1 time: 0.400744 Nov 16 19:01:43.322669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 26/57] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:42 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1279 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:43.583048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-653987c7-0b33-4fde-9756-ae5fc5abc1ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:43.583945 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-653987c7-0b33-4fde-9756-ae5fc5abc1ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:43.612122 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-653987c7-0b33-4fde-9756-ae5fc5abc1ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:43.614539 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-653987c7-0b33-4fde-9756-ae5fc5abc1ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:43.627249 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-653987c7-0b33-4fde-9756-ae5fc5abc1ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:43.631253 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-653987c7-0b33-4fde-9756-ae5fc5abc1ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:43.743342 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b9a294a7-b116-4605-a6d0-67c543f3ba90 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:43.754893 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b9a294a7-b116-4605-a6d0-67c543f3ba90 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.959387 Nov 16 19:01:43.755523 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 32/58] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:42 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:43.919816 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-6a79e1fd-6e3d-4530-ac87-6428e79ed2d4 req-90c322b2-288e-43d2-8339-ce78f02bcb9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7190b8e5-4def-4b46-bf21-dae43664c0ad", "tag": "e5571c38-77b9-4106-b9fd-2ba0f22a1929"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:43.923313 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:01:43.923313 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:01:43.960392 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-6a79e1fd-6e3d-4530-ac87-6428e79ed2d4 req-90c322b2-288e-43d2-8339-ce78f02bcb9b service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:43.960863 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-6a79e1fd-6e3d-4530-ac87-6428e79ed2d4 req-90c322b2-288e-43d2-8339-ce78f02bcb9b service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:44.026053 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-6a79e1fd-6e3d-4530-ac87-6428e79ed2d4 req-90c322b2-288e-43d2-8339-ce78f02bcb9b service nova] Creating event network-changed:e5571c38-77b9-4106-b9fd-2ba0f22a1929 for instance 7190b8e5-4def-4b46-bf21-dae43664c0ad on hv-cinder-66710 Nov 16 19:01:44.045783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-6a79e1fd-6e3d-4530-ac87-6428e79ed2d4 req-90c322b2-288e-43d2-8339-ce78f02bcb9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132795 Nov 16 19:01:44.058675 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 33/59] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:01:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:44.339974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9f4c3d2d-939f-46a9-9cad-bb6416d4f4c8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:44.341657 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9f4c3d2d-939f-46a9-9cad-bb6416d4f4c8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:44.366109 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f4c3d2d-939f-46a9-9cad-bb6416d4f4c8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:44.367443 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f4c3d2d-939f-46a9-9cad-bb6416d4f4c8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:44.370182 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f4c3d2d-939f-46a9-9cad-bb6416d4f4c8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:44.370876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f4c3d2d-939f-46a9-9cad-bb6416d4f4c8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:44.593739 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-653987c7-0b33-4fde-9756-ae5fc5abc1ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:44.607591 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-653987c7-0b33-4fde-9756-ae5fc5abc1ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 1.027419 Nov 16 19:01:44.608530 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 27/60] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:43 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:44.772363 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b44cbb71-1745-4c83-854b-7930e11485a4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:44.773798 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b44cbb71-1745-4c83-854b-7930e11485a4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:44.781502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b44cbb71-1745-4c83-854b-7930e11485a4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:44.782394 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b44cbb71-1745-4c83-854b-7930e11485a4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:44.785753 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b44cbb71-1745-4c83-854b-7930e11485a4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:44.787100 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b44cbb71-1745-4c83-854b-7930e11485a4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:45.054102 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9f4c3d2d-939f-46a9-9cad-bb6416d4f4c8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:45.065977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9f4c3d2d-939f-46a9-9cad-bb6416d4f4c8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.735358 Nov 16 19:01:45.075132 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 34/61] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:44 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:45.094656 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b44cbb71-1745-4c83-854b-7930e11485a4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:45.108202 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b44cbb71-1745-4c83-854b-7930e11485a4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.339337 Nov 16 19:01:45.117970 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 28/62] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:44 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:45.372872 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-471e9e89-568e-4353-8702-a13b7e048f3f req-a4602582-512f-47e7-87e4-bc403106dfed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22ea69e-6ab3-4ba5-b12b-f940430d6649", "tag": "856ad084-c410-48f2-95e0-5d307f2aff12"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:45.374538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:01:45.374538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:01:45.389089 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-471e9e89-568e-4353-8702-a13b7e048f3f req-a4602582-512f-47e7-87e4-bc403106dfed service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:45.389538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-471e9e89-568e-4353-8702-a13b7e048f3f req-a4602582-512f-47e7-87e4-bc403106dfed service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:45.412112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-471e9e89-568e-4353-8702-a13b7e048f3f req-a4602582-512f-47e7-87e4-bc403106dfed service nova] Creating event network-changed:856ad084-c410-48f2-95e0-5d307f2aff12 for instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 on hv-cinder-66710 Nov 16 19:01:45.423450 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-471e9e89-568e-4353-8702-a13b7e048f3f req-a4602582-512f-47e7-87e4-bc403106dfed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354863 Nov 16 19:01:45.424076 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 35/63] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:01:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:45.628496 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8aa41e03-cd6b-4e87-99b3-ff07448555ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:45.629184 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8aa41e03-cd6b-4e87-99b3-ff07448555ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:45.637109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8aa41e03-cd6b-4e87-99b3-ff07448555ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:45.637932 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8aa41e03-cd6b-4e87-99b3-ff07448555ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:45.640353 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8aa41e03-cd6b-4e87-99b3-ff07448555ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:45.641276 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8aa41e03-cd6b-4e87-99b3-ff07448555ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:45.894093 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8aa41e03-cd6b-4e87-99b3-ff07448555ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:45.903580 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8aa41e03-cd6b-4e87-99b3-ff07448555ba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.279219 Nov 16 19:01:45.904126 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 29/64] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:45 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:46.083763 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-289e13d6-22fa-4b78-97fa-f4b8808ff955 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:46.084480 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-289e13d6-22fa-4b78-97fa-f4b8808ff955 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:46.094074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-289e13d6-22fa-4b78-97fa-f4b8808ff955 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:46.098324 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-289e13d6-22fa-4b78-97fa-f4b8808ff955 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:46.099514 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-289e13d6-22fa-4b78-97fa-f4b8808ff955 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:46.100103 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-289e13d6-22fa-4b78-97fa-f4b8808ff955 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:46.123795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6f2b1e3a-69e2-4fcf-8192-c5f410947a89 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:46.124675 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6f2b1e3a-69e2-4fcf-8192-c5f410947a89 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:46.135351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f2b1e3a-69e2-4fcf-8192-c5f410947a89 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:46.136766 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f2b1e3a-69e2-4fcf-8192-c5f410947a89 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:46.137860 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f2b1e3a-69e2-4fcf-8192-c5f410947a89 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:46.149121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f2b1e3a-69e2-4fcf-8192-c5f410947a89 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:46.558585 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-289e13d6-22fa-4b78-97fa-f4b8808ff955 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:46.568904 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-289e13d6-22fa-4b78-97fa-f4b8808ff955 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.489541 Nov 16 19:01:46.575672 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 36/65] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:46 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:46.727186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6f2b1e3a-69e2-4fcf-8192-c5f410947a89 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:46.735892 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6f2b1e3a-69e2-4fcf-8192-c5f410947a89 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.615571 Nov 16 19:01:46.738857 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 30/66] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:46 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:46.920042 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-33f4611c-272f-4a08-8e77-05d2c29c8f7a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:46.920653 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-33f4611c-272f-4a08-8e77-05d2c29c8f7a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:46.927894 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-33f4611c-272f-4a08-8e77-05d2c29c8f7a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:46.928614 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-33f4611c-272f-4a08-8e77-05d2c29c8f7a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:46.929683 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-33f4611c-272f-4a08-8e77-05d2c29c8f7a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:46.930274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-33f4611c-272f-4a08-8e77-05d2c29c8f7a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:47.296834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-33f4611c-272f-4a08-8e77-05d2c29c8f7a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:47.304424 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-33f4611c-272f-4a08-8e77-05d2c29c8f7a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.387948 Nov 16 19:01:47.304995 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 37/67] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:46 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:47.487050 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-ba183f30-88f4-4e02-9d4a-7c0a4d8ff86b req-80608414-8b54-4fa6-b527-a29019d37e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a582c36-f154-4050-a431-1eea01999490", "tag": "57e6c1c0-bfcc-44c4-82b5-890dc4a034df"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:47.489460 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:01:47.489460 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:01:47.507427 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-ba183f30-88f4-4e02-9d4a-7c0a4d8ff86b req-80608414-8b54-4fa6-b527-a29019d37e07 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:47.512519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-ba183f30-88f4-4e02-9d4a-7c0a4d8ff86b req-80608414-8b54-4fa6-b527-a29019d37e07 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:47.541963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-ba183f30-88f4-4e02-9d4a-7c0a4d8ff86b req-80608414-8b54-4fa6-b527-a29019d37e07 service nova] Creating event network-changed:57e6c1c0-bfcc-44c4-82b5-890dc4a034df for instance 8a582c36-f154-4050-a431-1eea01999490 on hv-cinder-66710 Nov 16 19:01:47.542792 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-ba183f30-88f4-4e02-9d4a-7c0a4d8ff86b req-80608414-8b54-4fa6-b527-a29019d37e07 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 16 19:01:47.545093 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-816bbb74-fe45-4d40-b3db-886dbad1a773 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:47.545859 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-816bbb74-fe45-4d40-b3db-886dbad1a773 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:47.546953 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-816bbb74-fe45-4d40-b3db-886dbad1a773 None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:47.547493 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-816bbb74-fe45-4d40-b3db-886dbad1a773 None None] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:47.559140 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.compute.rpcapi [None req-816bbb74-fe45-4d40-b3db-886dbad1a773 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 16 19:01:47.560333 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-816bbb74-fe45-4d40-b3db-886dbad1a773 None None] Releasing lock "compute-rpcapi-router" {{(pid=116168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 16 19:01:47.591965 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2672acae-bd03-4935-bf32-48a0cf9d1eab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:47.592912 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2672acae-bd03-4935-bf32-48a0cf9d1eab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:47.604242 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2672acae-bd03-4935-bf32-48a0cf9d1eab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:47.607107 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2672acae-bd03-4935-bf32-48a0cf9d1eab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:47.608132 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2672acae-bd03-4935-bf32-48a0cf9d1eab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:47.608932 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2672acae-bd03-4935-bf32-48a0cf9d1eab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:47.612808 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-816bbb74-fe45-4d40-b3db-886dbad1a773 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130213 Nov 16 19:01:47.613894 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 31/68] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:01:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:47.758317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2e2fc628-c5ee-4482-9e07-7171ba173e38 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:47.759036 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2e2fc628-c5ee-4482-9e07-7171ba173e38 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:47.779048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2e2fc628-c5ee-4482-9e07-7171ba173e38 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:47.779633 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2e2fc628-c5ee-4482-9e07-7171ba173e38 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:47.784740 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2e2fc628-c5ee-4482-9e07-7171ba173e38 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:47.785265 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2e2fc628-c5ee-4482-9e07-7171ba173e38 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:48.075974 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2e2fc628-c5ee-4482-9e07-7171ba173e38 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:48.095077 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2e2fc628-c5ee-4482-9e07-7171ba173e38 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.342700 Nov 16 19:01:48.108265 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 32/69] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:47 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:48.288589 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2672acae-bd03-4935-bf32-48a0cf9d1eab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:48.306445 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2672acae-bd03-4935-bf32-48a0cf9d1eab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.718105 Nov 16 19:01:48.321309 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-93e65538-98be-4f29-9686-ed2ad3df67b7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:48.322132 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-93e65538-98be-4f29-9686-ed2ad3df67b7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:48.327801 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 38/70] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:47 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:48.331156 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93e65538-98be-4f29-9686-ed2ad3df67b7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:48.331890 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93e65538-98be-4f29-9686-ed2ad3df67b7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:48.332899 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93e65538-98be-4f29-9686-ed2ad3df67b7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:48.333752 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93e65538-98be-4f29-9686-ed2ad3df67b7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:48.653225 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-93e65538-98be-4f29-9686-ed2ad3df67b7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:48.660785 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-93e65538-98be-4f29-9686-ed2ad3df67b7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.343345 Nov 16 19:01:48.661357 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 33/71] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:48 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:49.121593 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8fa4ee8c-6001-49a6-bed0-77a21e3fc2d1 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:49.121593 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8fa4ee8c-6001-49a6-bed0-77a21e3fc2d1 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:49.127176 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8fa4ee8c-6001-49a6-bed0-77a21e3fc2d1 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:49.127816 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8fa4ee8c-6001-49a6-bed0-77a21e3fc2d1 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:49.128671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8fa4ee8c-6001-49a6-bed0-77a21e3fc2d1 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:49.129171 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8fa4ee8c-6001-49a6-bed0-77a21e3fc2d1 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:49.324708 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d7b1c236-cf27-431d-9514-fdc10a5ae5c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:49.325329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d7b1c236-cf27-431d-9514-fdc10a5ae5c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:49.336736 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7b1c236-cf27-431d-9514-fdc10a5ae5c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:49.338162 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7b1c236-cf27-431d-9514-fdc10a5ae5c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:49.339007 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7b1c236-cf27-431d-9514-fdc10a5ae5c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:49.339452 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7b1c236-cf27-431d-9514-fdc10a5ae5c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:49.367733 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-8fa4ee8c-6001-49a6-bed0-77a21e3fc2d1 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:49.386518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8fa4ee8c-6001-49a6-bed0-77a21e3fc2d1 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.275197 Nov 16 19:01:49.389686 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 39/72] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:49 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:49.681044 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a2c2960d-b59a-4372-9f1e-318fb9f3591e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:49.683497 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a2c2960d-b59a-4372-9f1e-318fb9f3591e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:49.692151 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d7b1c236-cf27-431d-9514-fdc10a5ae5c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:49.699929 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a2c2960d-b59a-4372-9f1e-318fb9f3591e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:49.700404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a2c2960d-b59a-4372-9f1e-318fb9f3591e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:49.703275 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a2c2960d-b59a-4372-9f1e-318fb9f3591e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:49.704454 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d7b1c236-cf27-431d-9514-fdc10a5ae5c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.385383 Nov 16 19:01:49.705028 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 34/73] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:49 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:49.705125 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a2c2960d-b59a-4372-9f1e-318fb9f3591e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:49.936699 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a2c2960d-b59a-4372-9f1e-318fb9f3591e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:49.951894 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a2c2960d-b59a-4372-9f1e-318fb9f3591e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.275600 Nov 16 19:01:49.953620 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 40/74] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:49 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:50.406980 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-748600cb-82f7-4a00-a5c3-d683021ad34d tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:50.407625 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-748600cb-82f7-4a00-a5c3-d683021ad34d tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:50.428813 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-748600cb-82f7-4a00-a5c3-d683021ad34d tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:50.429360 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-748600cb-82f7-4a00-a5c3-d683021ad34d tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:50.430204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-748600cb-82f7-4a00-a5c3-d683021ad34d tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:50.430641 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-748600cb-82f7-4a00-a5c3-d683021ad34d tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:50.617284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-748600cb-82f7-4a00-a5c3-d683021ad34d tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:50.630130 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-4a123ab7-1efe-4ba5-923a-beafa53b1422 req-b97a2a38-1238-46d7-a4d9-3f2a98862f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8df9df9-abb5-47f5-ba35-590c9d13ef80", "name": "network-vif-plugged", "status": "completed", "tag": "80c2bad8-ab54-4cb0-8aa8-cb0d47a28f5d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:50.638413 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:01:50.638413 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:01:50.652810 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-748600cb-82f7-4a00-a5c3-d683021ad34d tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.249969 Nov 16 19:01:50.661239 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 41/75] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:50 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:50.673096 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-4a123ab7-1efe-4ba5-923a-beafa53b1422 req-b97a2a38-1238-46d7-a4d9-3f2a98862f40 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:50.673570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-4a123ab7-1efe-4ba5-923a-beafa53b1422 req-b97a2a38-1238-46d7-a4d9-3f2a98862f40 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:50.685431 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-4a123ab7-1efe-4ba5-923a-beafa53b1422 req-b97a2a38-1238-46d7-a4d9-3f2a98862f40 service nova] Creating event network-vif-plugged:80c2bad8-ab54-4cb0-8aa8-cb0d47a28f5d for instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 on hv-cinder-66710 Nov 16 19:01:50.691828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-4a123ab7-1efe-4ba5-923a-beafa53b1422 req-b97a2a38-1238-46d7-a4d9-3f2a98862f40 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.348948 Nov 16 19:01:50.692574 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 35/76] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:01:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:50.724334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f2745be5-2ac3-489f-a47e-1e8256cc761f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:50.725522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f2745be5-2ac3-489f-a47e-1e8256cc761f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:50.732656 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f2745be5-2ac3-489f-a47e-1e8256cc761f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:50.733413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f2745be5-2ac3-489f-a47e-1e8256cc761f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:50.734405 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f2745be5-2ac3-489f-a47e-1e8256cc761f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:50.734851 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f2745be5-2ac3-489f-a47e-1e8256cc761f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:50.948471 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f2745be5-2ac3-489f-a47e-1e8256cc761f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:50.964453 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f2745be5-2ac3-489f-a47e-1e8256cc761f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.245855 Nov 16 19:01:50.965443 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 42/77] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:50 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:50.975710 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-08a91808-d497-4733-b502-6fa5d61b7723 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:50.976608 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-08a91808-d497-4733-b502-6fa5d61b7723 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:50.984434 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08a91808-d497-4733-b502-6fa5d61b7723 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:50.985437 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08a91808-d497-4733-b502-6fa5d61b7723 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:50.986471 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08a91808-d497-4733-b502-6fa5d61b7723 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:50.987319 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08a91808-d497-4733-b502-6fa5d61b7723 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:51.166844 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-08a91808-d497-4733-b502-6fa5d61b7723 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:51.175191 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-08a91808-d497-4733-b502-6fa5d61b7723 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.203388 Nov 16 19:01:51.175763 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 36/78] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:50 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:51.677834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-35d63ec3-bee7-4529-834d-6f6bb2ef807b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:51.679517 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-35d63ec3-bee7-4529-834d-6f6bb2ef807b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:51.691412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-35d63ec3-bee7-4529-834d-6f6bb2ef807b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:51.691876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-35d63ec3-bee7-4529-834d-6f6bb2ef807b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:51.697030 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-35d63ec3-bee7-4529-834d-6f6bb2ef807b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:51.697752 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-35d63ec3-bee7-4529-834d-6f6bb2ef807b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:51.898898 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-35d63ec3-bee7-4529-834d-6f6bb2ef807b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:51.908907 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-35d63ec3-bee7-4529-834d-6f6bb2ef807b tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.235007 Nov 16 19:01:51.910692 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 43/79] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:51 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:51.993370 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e9ec53df-60ba-46f6-a381-ea4b4371eb8a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:51.996896 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e9ec53df-60ba-46f6-a381-ea4b4371eb8a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:52.010738 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9ec53df-60ba-46f6-a381-ea4b4371eb8a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:52.012395 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9ec53df-60ba-46f6-a381-ea4b4371eb8a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:52.013418 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9ec53df-60ba-46f6-a381-ea4b4371eb8a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:52.014095 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9ec53df-60ba-46f6-a381-ea4b4371eb8a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:52.192132 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-108fce76-391a-4fcf-981b-b0c48536a2e4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:52.192735 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-108fce76-391a-4fcf-981b-b0c48536a2e4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:52.195721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e9ec53df-60ba-46f6-a381-ea4b4371eb8a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:52.200942 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-108fce76-391a-4fcf-981b-b0c48536a2e4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:52.202023 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-108fce76-391a-4fcf-981b-b0c48536a2e4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:52.203209 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-108fce76-391a-4fcf-981b-b0c48536a2e4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:52.203993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-108fce76-391a-4fcf-981b-b0c48536a2e4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:52.207519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e9ec53df-60ba-46f6-a381-ea4b4371eb8a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.227451 Nov 16 19:01:52.209376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 37/80] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:51 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:52.365895 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-108fce76-391a-4fcf-981b-b0c48536a2e4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:52.377285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-108fce76-391a-4fcf-981b-b0c48536a2e4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.188361 Nov 16 19:01:52.378100 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 44/81] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:52 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:52.713224 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-ea9426ad-fd1f-4981-b064-de345382f136 req-a8f3e491-ca98-4600-8aeb-c8f47ec9a4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7190b8e5-4def-4b46-bf21-dae43664c0ad", "name": "network-vif-plugged", "status": "completed", "tag": "e5571c38-77b9-4106-b9fd-2ba0f22a1929"}, {"server_uuid": "c22ea69e-6ab3-4ba5-b12b-f940430d6649", "name": "network-vif-plugged", "status": "completed", "tag": "856ad084-c410-48f2-95e0-5d307f2aff12"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:52.714911 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:01:52.714911 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:01:52.722659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-ea9426ad-fd1f-4981-b064-de345382f136 req-a8f3e491-ca98-4600-8aeb-c8f47ec9a4e9 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:52.723259 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-ea9426ad-fd1f-4981-b064-de345382f136 req-a8f3e491-ca98-4600-8aeb-c8f47ec9a4e9 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:52.738636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-ea9426ad-fd1f-4981-b064-de345382f136 req-a8f3e491-ca98-4600-8aeb-c8f47ec9a4e9 service nova] Creating event network-vif-plugged:e5571c38-77b9-4106-b9fd-2ba0f22a1929 for instance 7190b8e5-4def-4b46-bf21-dae43664c0ad on hv-cinder-66710 Nov 16 19:01:52.739363 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-ea9426ad-fd1f-4981-b064-de345382f136 req-a8f3e491-ca98-4600-8aeb-c8f47ec9a4e9 service nova] Creating event network-vif-plugged:856ad084-c410-48f2-95e0-5d307f2aff12 for instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 on hv-cinder-66710 Nov 16 19:01:52.747121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-ea9426ad-fd1f-4981-b064-de345382f136 req-a8f3e491-ca98-4600-8aeb-c8f47ec9a4e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038103 Nov 16 19:01:52.748421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 38/82] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:01:52 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:52.927393 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-66917ce8-8d10-4753-9782-4cc58b7c78e6 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:52.927999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-66917ce8-8d10-4753-9782-4cc58b7c78e6 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:52.934336 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-66917ce8-8d10-4753-9782-4cc58b7c78e6 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:52.934776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-66917ce8-8d10-4753-9782-4cc58b7c78e6 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:52.935727 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-66917ce8-8d10-4753-9782-4cc58b7c78e6 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:52.936155 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-66917ce8-8d10-4753-9782-4cc58b7c78e6 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:53.073426 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-66917ce8-8d10-4753-9782-4cc58b7c78e6 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:53.080932 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-66917ce8-8d10-4753-9782-4cc58b7c78e6 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.157228 Nov 16 19:01:53.081379 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 45/83] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:52 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:53.227096 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-09eefa3b-8c1f-4628-b827-aaef99a3355c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:53.227782 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-09eefa3b-8c1f-4628-b827-aaef99a3355c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:53.234519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09eefa3b-8c1f-4628-b827-aaef99a3355c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:53.235048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09eefa3b-8c1f-4628-b827-aaef99a3355c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:53.236125 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09eefa3b-8c1f-4628-b827-aaef99a3355c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:53.236760 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09eefa3b-8c1f-4628-b827-aaef99a3355c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:53.394518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3c4de079-8475-4623-9240-465f45340595 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:53.395478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3c4de079-8475-4623-9240-465f45340595 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:53.405176 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3c4de079-8475-4623-9240-465f45340595 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:53.405658 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3c4de079-8475-4623-9240-465f45340595 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:53.406446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3c4de079-8475-4623-9240-465f45340595 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:53.406886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3c4de079-8475-4623-9240-465f45340595 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:53.480253 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-09eefa3b-8c1f-4628-b827-aaef99a3355c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:53.487773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-09eefa3b-8c1f-4628-b827-aaef99a3355c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.265575 Nov 16 19:01:53.490408 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 39/84] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:53 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:53.611791 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3c4de079-8475-4623-9240-465f45340595 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:53.625328 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3c4de079-8475-4623-9240-465f45340595 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.234329 Nov 16 19:01:53.626201 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 46/85] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:53 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:54.097823 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d346a8a2-6ad6-4324-91a1-8c0b0128e6cf tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:54.098610 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d346a8a2-6ad6-4324-91a1-8c0b0128e6cf tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:54.105230 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d346a8a2-6ad6-4324-91a1-8c0b0128e6cf tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:54.105717 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d346a8a2-6ad6-4324-91a1-8c0b0128e6cf tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:54.106555 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d346a8a2-6ad6-4324-91a1-8c0b0128e6cf tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:54.107144 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d346a8a2-6ad6-4324-91a1-8c0b0128e6cf tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:54.248523 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d346a8a2-6ad6-4324-91a1-8c0b0128e6cf tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:54.256089 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d346a8a2-6ad6-4324-91a1-8c0b0128e6cf tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.162219 Nov 16 19:01:54.257242 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 40/86] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:54 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:54.509250 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2e131650-9f67-4159-add0-d5b0164e2b7a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:54.511181 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2e131650-9f67-4159-add0-d5b0164e2b7a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:54.522874 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2e131650-9f67-4159-add0-d5b0164e2b7a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:54.523961 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2e131650-9f67-4159-add0-d5b0164e2b7a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:54.524972 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2e131650-9f67-4159-add0-d5b0164e2b7a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:54.525653 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2e131650-9f67-4159-add0-d5b0164e2b7a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:54.644795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-52602810-4edb-4b1c-b03a-ba7fa69cd417 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:54.645397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-52602810-4edb-4b1c-b03a-ba7fa69cd417 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:54.655004 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52602810-4edb-4b1c-b03a-ba7fa69cd417 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:54.655483 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52602810-4edb-4b1c-b03a-ba7fa69cd417 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:54.656251 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52602810-4edb-4b1c-b03a-ba7fa69cd417 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:54.656684 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52602810-4edb-4b1c-b03a-ba7fa69cd417 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:54.894995 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2e131650-9f67-4159-add0-d5b0164e2b7a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:54.901470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2e131650-9f67-4159-add0-d5b0164e2b7a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.397357 Nov 16 19:01:54.904915 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 47/87] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:54 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:54.924293 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-52602810-4edb-4b1c-b03a-ba7fa69cd417 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:54.931970 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-52602810-4edb-4b1c-b03a-ba7fa69cd417 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.291476 Nov 16 19:01:54.932550 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 41/88] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:54 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:55.274012 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b0d01964-e01d-4618-b972-ba21e8d5a150 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:55.274747 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b0d01964-e01d-4618-b972-ba21e8d5a150 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:55.280642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b0d01964-e01d-4618-b972-ba21e8d5a150 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:55.281215 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b0d01964-e01d-4618-b972-ba21e8d5a150 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:55.282137 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b0d01964-e01d-4618-b972-ba21e8d5a150 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:55.282671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b0d01964-e01d-4618-b972-ba21e8d5a150 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:55.437566 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b0d01964-e01d-4618-b972-ba21e8d5a150 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:55.445894 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b0d01964-e01d-4618-b972-ba21e8d5a150 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1315 microversion: 2.1 time: 0.176116 Nov 16 19:01:55.446549 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 48/89] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:55 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:55.923052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-93f31173-2df8-40f7-a897-1ff546a5eb0f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:55.923667 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-93f31173-2df8-40f7-a897-1ff546a5eb0f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:55.931769 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93f31173-2df8-40f7-a897-1ff546a5eb0f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:55.932541 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93f31173-2df8-40f7-a897-1ff546a5eb0f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:55.933421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93f31173-2df8-40f7-a897-1ff546a5eb0f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:55.933887 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93f31173-2df8-40f7-a897-1ff546a5eb0f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:55.949136 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6218d32d-df90-4936-a023-ac0c663a5fbb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:55.949774 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6218d32d-df90-4936-a023-ac0c663a5fbb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:55.961180 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6218d32d-df90-4936-a023-ac0c663a5fbb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:55.961655 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6218d32d-df90-4936-a023-ac0c663a5fbb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:55.962436 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6218d32d-df90-4936-a023-ac0c663a5fbb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:55.962873 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6218d32d-df90-4936-a023-ac0c663a5fbb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:56.161587 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-93f31173-2df8-40f7-a897-1ff546a5eb0f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:56.169334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6218d32d-df90-4936-a023-ac0c663a5fbb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:56.181265 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-93f31173-2df8-40f7-a897-1ff546a5eb0f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.261900 Nov 16 19:01:56.188598 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6218d32d-df90-4936-a023-ac0c663a5fbb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1363 microversion: 2.1 time: 0.243057 Nov 16 19:01:56.189384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 49/90] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:55 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:56.202335 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 42/91] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:55 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:56.468533 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c61eb171-d7b3-4344-aa2a-12e2206c5571 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:56.469137 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c61eb171-d7b3-4344-aa2a-12e2206c5571 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:56.476326 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c61eb171-d7b3-4344-aa2a-12e2206c5571 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:56.476771 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c61eb171-d7b3-4344-aa2a-12e2206c5571 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:56.477519 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c61eb171-d7b3-4344-aa2a-12e2206c5571 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:56.477986 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c61eb171-d7b3-4344-aa2a-12e2206c5571 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:56.666014 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c61eb171-d7b3-4344-aa2a-12e2206c5571 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:56.673601 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c61eb171-d7b3-4344-aa2a-12e2206c5571 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1501 microversion: 2.1 time: 0.210028 Nov 16 19:01:56.674235 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 50/92] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:56 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1501 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:57.206225 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3bfe2443-68b5-4e02-8692-18f34d777122 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:57.207773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3bfe2443-68b5-4e02-8692-18f34d777122 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:57.214228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3bfe2443-68b5-4e02-8692-18f34d777122 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:57.214987 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3bfe2443-68b5-4e02-8692-18f34d777122 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:57.216302 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3bfe2443-68b5-4e02-8692-18f34d777122 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:57.217170 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3bfe2443-68b5-4e02-8692-18f34d777122 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:57.218601 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-36c97cfc-dde1-4e43-9960-f8f8033dbbe3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:57.219214 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-36c97cfc-dde1-4e43-9960-f8f8033dbbe3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:57.228541 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-36c97cfc-dde1-4e43-9960-f8f8033dbbe3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:57.238404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-36c97cfc-dde1-4e43-9960-f8f8033dbbe3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:57.239467 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-36c97cfc-dde1-4e43-9960-f8f8033dbbe3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:57.242483 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-36c97cfc-dde1-4e43-9960-f8f8033dbbe3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:57.383128 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3bfe2443-68b5-4e02-8692-18f34d777122 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:57.393529 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3bfe2443-68b5-4e02-8692-18f34d777122 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1546 microversion: 2.1 time: 0.191478 Nov 16 19:01:57.394434 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 43/93] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:57 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1546 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:01:57.413511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7b361c2c-fea3-4e21-8a12-f948c8f12fe9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:57.414310 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7b361c2c-fea3-4e21-8a12-f948c8f12fe9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:57.420891 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b361c2c-fea3-4e21-8a12-f948c8f12fe9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:57.423775 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b361c2c-fea3-4e21-8a12-f948c8f12fe9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:57.425991 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b361c2c-fea3-4e21-8a12-f948c8f12fe9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:57.426766 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b361c2c-fea3-4e21-8a12-f948c8f12fe9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:57.515014 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-36c97cfc-dde1-4e43-9960-f8f8033dbbe3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:57.524495 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-36c97cfc-dde1-4e43-9960-f8f8033dbbe3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.309338 Nov 16 19:01:57.525889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 51/94] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:57 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:57.568889 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7b361c2c-fea3-4e21-8a12-f948c8f12fe9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159200 Nov 16 19:01:57.570567 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 44/95] 10.222.0.46 () {58 vars in 1274 bytes} [Tue Nov 16 19:01:57 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:57.579742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-32b40d56-07a5-4c5f-8bb4-22ccbb7874a2 req-d8bb0844-2b0c-4b78-bf17-784febc8c6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a582c36-f154-4050-a431-1eea01999490", "name": "network-vif-plugged", "status": "completed", "tag": "57e6c1c0-bfcc-44c4-82b5-890dc4a034df"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:57.581732 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:01:57.581732 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:01:57.590469 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-32b40d56-07a5-4c5f-8bb4-22ccbb7874a2 req-d8bb0844-2b0c-4b78-bf17-784febc8c6a2 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:57.591120 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-32b40d56-07a5-4c5f-8bb4-22ccbb7874a2 req-d8bb0844-2b0c-4b78-bf17-784febc8c6a2 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:57.606184 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-32b40d56-07a5-4c5f-8bb4-22ccbb7874a2 req-d8bb0844-2b0c-4b78-bf17-784febc8c6a2 service nova] Creating event network-vif-plugged:57e6c1c0-bfcc-44c4-82b5-890dc4a034df for instance 8a582c36-f154-4050-a431-1eea01999490 on hv-cinder-66710 Nov 16 19:01:57.613357 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-32b40d56-07a5-4c5f-8bb4-22ccbb7874a2 req-d8bb0844-2b0c-4b78-bf17-784febc8c6a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038461 Nov 16 19:01:57.624206 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 52/96] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:01:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:58.055365 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-343572fd-056e-4dee-9e7f-d129b769530f tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e26ae1-8800-43ef-9855-58172beb1b0d"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:58.057116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-343572fd-056e-4dee-9e7f-d129b769530f tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:58.076310 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-343572fd-056e-4dee-9e7f-d129b769530f tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:58.077058 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-343572fd-056e-4dee-9e7f-d129b769530f tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:58.078410 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-343572fd-056e-4dee-9e7f-d129b769530f tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:58.079035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-343572fd-056e-4dee-9e7f-d129b769530f tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:58.546088 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4b1adbc5-415a-4898-9d90-1ed98347b9e8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:58.546818 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4b1adbc5-415a-4898-9d90-1ed98347b9e8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:58.567087 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b1adbc5-415a-4898-9d90-1ed98347b9e8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:58.567617 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b1adbc5-415a-4898-9d90-1ed98347b9e8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:58.568465 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b1adbc5-415a-4898-9d90-1ed98347b9e8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:58.568962 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b1adbc5-415a-4898-9d90-1ed98347b9e8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:58.795511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-343572fd-056e-4dee-9e7f-d129b769530f tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "POST /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745577 Nov 16 19:01:58.802009 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 45/97] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:01:58 2021] POST /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80/os-volume_attachments => generated 194 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:01:58.860874 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4b1adbc5-415a-4898-9d90-1ed98347b9e8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:01:58.872197 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4b1adbc5-415a-4898-9d90-1ed98347b9e8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1321 microversion: 2.1 time: 0.332538 Nov 16 19:01:58.872867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 53/98] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:58 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:01:59.889141 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9f06a37d-e80a-43c8-9ec9-077d29e7c399 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:01:59.890629 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9f06a37d-e80a-43c8-9ec9-077d29e7c399 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:59.899855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9f06a37d-e80a-43c8-9ec9-077d29e7c399 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:59.900542 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9f06a37d-e80a-43c8-9ec9-077d29e7c399 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:59.902768 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9f06a37d-e80a-43c8-9ec9-077d29e7c399 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:59.903420 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9f06a37d-e80a-43c8-9ec9-077d29e7c399 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:59.961446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-01a62877-22f6-452d-8b7d-61850b8e19ad tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:01:59.978295 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-01a62877-22f6-452d-8b7d-61850b8e19ad tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:01:59.992204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01a62877-22f6-452d-8b7d-61850b8e19ad tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:59.992564 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01a62877-22f6-452d-8b7d-61850b8e19ad tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:01:59.996059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01a62877-22f6-452d-8b7d-61850b8e19ad tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:01:59.996524 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01a62877-22f6-452d-8b7d-61850b8e19ad tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:00.235506 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9f06a37d-e80a-43c8-9ec9-077d29e7c399 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:00.244038 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9f06a37d-e80a-43c8-9ec9-077d29e7c399 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1515 microversion: 2.1 time: 0.359218 Nov 16 19:02:00.244945 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 46/99] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:01:59 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1515 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:00.257324 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-01a62877-22f6-452d-8b7d-61850b8e19ad tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 14 microversion: 2.1 time: 0.306276 Nov 16 19:02:00.258094 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 54/100] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:01:59 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 14 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:00.265819 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f6681311-cb4d-4feb-9930-9b38685c99da tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:00.266903 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f6681311-cb4d-4feb-9930-9b38685c99da tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:00.274261 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-09f411c2-d577-41f5-b3a9-9430122c0072 req-406c9d0c-a8a5-4bac-b691-2dba7c58aee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7190b8e5-4def-4b46-bf21-dae43664c0ad", "tag": "e5571c38-77b9-4106-b9fd-2ba0f22a1929"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:00.275897 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6681311-cb4d-4feb-9930-9b38685c99da tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:00.276537 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6681311-cb4d-4feb-9930-9b38685c99da tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:00.277741 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6681311-cb4d-4feb-9930-9b38685c99da tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:00.278419 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6681311-cb4d-4feb-9930-9b38685c99da tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:00.279268 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:02:00.279268 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:02:00.300976 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-09f411c2-d577-41f5-b3a9-9430122c0072 req-406c9d0c-a8a5-4bac-b691-2dba7c58aee1 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:00.301641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-09f411c2-d577-41f5-b3a9-9430122c0072 req-406c9d0c-a8a5-4bac-b691-2dba7c58aee1 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:00.321873 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-f6681311-cb4d-4feb-9930-9b38685c99da tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lazy-loading 'flavor' on Instance uuid 8a582c36-f154-4050-a431-1eea01999490 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:02:00.331519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-09f411c2-d577-41f5-b3a9-9430122c0072 req-406c9d0c-a8a5-4bac-b691-2dba7c58aee1 service nova] Creating event network-changed:e5571c38-77b9-4106-b9fd-2ba0f22a1929 for instance 7190b8e5-4def-4b46-bf21-dae43664c0ad on hv-cinder-66710 Nov 16 19:02:00.345526 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-09f411c2-d577-41f5-b3a9-9430122c0072 req-406c9d0c-a8a5-4bac-b691-2dba7c58aee1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099165 Nov 16 19:02:00.349781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 47/101] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:02:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:02:00.488012 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f6681311-cb4d-4feb-9930-9b38685c99da tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490/action" status: 200 len: 32 microversion: 2.1 time: 0.228655 Nov 16 19:02:00.489206 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 55/102] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:00 2021] POST /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:00.498980 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5affc1df-1df1-44f7-9bd1-743d691c45df tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:00.499966 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5affc1df-1df1-44f7-9bd1-743d691c45df tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:00.516348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5affc1df-1df1-44f7-9bd1-743d691c45df tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:00.518186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5affc1df-1df1-44f7-9bd1-743d691c45df tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:00.520879 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5affc1df-1df1-44f7-9bd1-743d691c45df tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:00.533751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5affc1df-1df1-44f7-9bd1-743d691c45df tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:00.791329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5affc1df-1df1-44f7-9bd1-743d691c45df tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:00.799203 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5affc1df-1df1-44f7-9bd1-743d691c45df tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.304522 Nov 16 19:02:00.799776 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 48/103] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:00 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:01.276693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-855e6da1-b0ad-454f-b709-a75981b7b336 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:01.283418 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-855e6da1-b0ad-454f-b709-a75981b7b336 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:01.312757 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-855e6da1-b0ad-454f-b709-a75981b7b336 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:01.320238 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-855e6da1-b0ad-454f-b709-a75981b7b336 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:01.321089 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-855e6da1-b0ad-454f-b709-a75981b7b336 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:01.321529 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-855e6da1-b0ad-454f-b709-a75981b7b336 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:01.431272 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-855e6da1-b0ad-454f-b709-a75981b7b336 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 14 microversion: 2.1 time: 0.159275 Nov 16 19:02:01.432398 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 56/104] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:01 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 19:02:01.817342 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ade0ce34-0530-44f2-aa63-daf785243090 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:01.818721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ade0ce34-0530-44f2-aa63-daf785243090 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:01.834715 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ade0ce34-0530-44f2-aa63-daf785243090 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:01.835834 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ade0ce34-0530-44f2-aa63-daf785243090 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:01.837153 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ade0ce34-0530-44f2-aa63-daf785243090 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:01.838050 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ade0ce34-0530-44f2-aa63-daf785243090 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:02.027825 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ade0ce34-0530-44f2-aa63-daf785243090 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:02.037206 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ade0ce34-0530-44f2-aa63-daf785243090 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.223487 Nov 16 19:02:02.048816 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 49/105] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:01 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:02.447606 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-79822b48-f534-44c9-81d5-4ded29e6d71e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:02.448676 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-79822b48-f534-44c9-81d5-4ded29e6d71e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:02.476671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-79822b48-f534-44c9-81d5-4ded29e6d71e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:02.477137 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-79822b48-f534-44c9-81d5-4ded29e6d71e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:02.477944 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-79822b48-f534-44c9-81d5-4ded29e6d71e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:02.478376 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-79822b48-f534-44c9-81d5-4ded29e6d71e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:02.570788 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-79822b48-f534-44c9-81d5-4ded29e6d71e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 14 microversion: 2.1 time: 0.131697 Nov 16 19:02:02.571731 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 57/106] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:02 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:03.056888 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-821e02be-958f-4094-a4d5-85d1d07cc0c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:03.057498 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-821e02be-958f-4094-a4d5-85d1d07cc0c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:03.064158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-821e02be-958f-4094-a4d5-85d1d07cc0c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:03.064817 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-821e02be-958f-4094-a4d5-85d1d07cc0c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:03.065788 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-821e02be-958f-4094-a4d5-85d1d07cc0c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:03.066367 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-821e02be-958f-4094-a4d5-85d1d07cc0c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:03.232591 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-821e02be-958f-4094-a4d5-85d1d07cc0c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:03.242122 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-821e02be-958f-4094-a4d5-85d1d07cc0c3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.190547 Nov 16 19:02:03.245406 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 50/107] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:03 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:03.582383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a6774dfe-ceb1-44b2-8d8d-8b32387dedc8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:03.584109 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a6774dfe-ceb1-44b2-8d8d-8b32387dedc8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:03.592032 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a6774dfe-ceb1-44b2-8d8d-8b32387dedc8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:03.592749 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a6774dfe-ceb1-44b2-8d8d-8b32387dedc8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:03.593809 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a6774dfe-ceb1-44b2-8d8d-8b32387dedc8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:03.595062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a6774dfe-ceb1-44b2-8d8d-8b32387dedc8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:03.679285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a6774dfe-ceb1-44b2-8d8d-8b32387dedc8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 14 microversion: 2.1 time: 0.100369 Nov 16 19:02:03.679938 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 58/108] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:03 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:04.270820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1e22afe4-2158-4e66-a4d6-313d9c5a860e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:04.271385 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1e22afe4-2158-4e66-a4d6-313d9c5a860e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:04.282701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e22afe4-2158-4e66-a4d6-313d9c5a860e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:04.282987 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e22afe4-2158-4e66-a4d6-313d9c5a860e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:04.283897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e22afe4-2158-4e66-a4d6-313d9c5a860e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:04.284386 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e22afe4-2158-4e66-a4d6-313d9c5a860e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:04.450988 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1e22afe4-2158-4e66-a4d6-313d9c5a860e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:04.461335 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1e22afe4-2158-4e66-a4d6-313d9c5a860e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.204775 Nov 16 19:02:04.471469 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 51/109] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:04 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:04.697961 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5481378c-e913-4a03-8e4b-5a596fc4a0da tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:04.699256 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5481378c-e913-4a03-8e4b-5a596fc4a0da tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:04.721786 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5481378c-e913-4a03-8e4b-5a596fc4a0da tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:04.722667 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5481378c-e913-4a03-8e4b-5a596fc4a0da tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:04.727084 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5481378c-e913-4a03-8e4b-5a596fc4a0da tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:04.727647 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5481378c-e913-4a03-8e4b-5a596fc4a0da tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:04.819522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5481378c-e913-4a03-8e4b-5a596fc4a0da tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 14 microversion: 2.1 time: 0.127803 Nov 16 19:02:04.821419 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 59/110] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:04 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:05.478628 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f65703b1-56a0-4535-981b-f290ad10db06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:05.479481 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f65703b1-56a0-4535-981b-f290ad10db06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:05.486674 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f65703b1-56a0-4535-981b-f290ad10db06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:05.487712 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f65703b1-56a0-4535-981b-f290ad10db06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:05.488938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f65703b1-56a0-4535-981b-f290ad10db06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:05.489910 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f65703b1-56a0-4535-981b-f290ad10db06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:05.660832 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f65703b1-56a0-4535-981b-f290ad10db06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:05.668604 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f65703b1-56a0-4535-981b-f290ad10db06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.194102 Nov 16 19:02:05.669174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 52/111] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:05 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:05.832107 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b539f470-4b9c-4820-8f7f-c1c374b01092 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:05.833207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b539f470-4b9c-4820-8f7f-c1c374b01092 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:05.840155 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b539f470-4b9c-4820-8f7f-c1c374b01092 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:05.840595 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b539f470-4b9c-4820-8f7f-c1c374b01092 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:05.841366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b539f470-4b9c-4820-8f7f-c1c374b01092 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:05.841836 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b539f470-4b9c-4820-8f7f-c1c374b01092 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:05.920463 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b539f470-4b9c-4820-8f7f-c1c374b01092 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 14 microversion: 2.1 time: 0.092337 Nov 16 19:02:05.923542 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 60/112] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:05 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:06.687673 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-163134c7-e4ce-421a-a349-3f826242a1fb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:06.688289 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-163134c7-e4ce-421a-a349-3f826242a1fb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:06.695235 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-163134c7-e4ce-421a-a349-3f826242a1fb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:06.695675 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-163134c7-e4ce-421a-a349-3f826242a1fb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:06.696653 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-163134c7-e4ce-421a-a349-3f826242a1fb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:06.697086 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-163134c7-e4ce-421a-a349-3f826242a1fb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:06.861157 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-163134c7-e4ce-421a-a349-3f826242a1fb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:06.869000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-163134c7-e4ce-421a-a349-3f826242a1fb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.185228 Nov 16 19:02:06.869759 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 53/113] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:06 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:06.931470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-109dd163-6e6a-4711-b428-c160cd56bd03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:06.932470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-109dd163-6e6a-4711-b428-c160cd56bd03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:06.938709 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-109dd163-6e6a-4711-b428-c160cd56bd03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:06.939150 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-109dd163-6e6a-4711-b428-c160cd56bd03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:06.939970 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-109dd163-6e6a-4711-b428-c160cd56bd03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:06.940338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-109dd163-6e6a-4711-b428-c160cd56bd03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:07.887240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2384d0ac-c21a-4884-860b-994ff0fd87f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:07.887895 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2384d0ac-c21a-4884-860b-994ff0fd87f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:07.896063 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2384d0ac-c21a-4884-860b-994ff0fd87f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:07.897610 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2384d0ac-c21a-4884-860b-994ff0fd87f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:07.898397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2384d0ac-c21a-4884-860b-994ff0fd87f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:07.899265 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2384d0ac-c21a-4884-860b-994ff0fd87f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:08.038285 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2384d0ac-c21a-4884-860b-994ff0fd87f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:08.050616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2384d0ac-c21a-4884-860b-994ff0fd87f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.167799 Nov 16 19:02:08.062606 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 54/114] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:07 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:09.069331 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7fe74528-31a5-40da-82cf-2d08bbf12de2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:09.069997 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7fe74528-31a5-40da-82cf-2d08bbf12de2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:09.077152 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7fe74528-31a5-40da-82cf-2d08bbf12de2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:09.077621 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7fe74528-31a5-40da-82cf-2d08bbf12de2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:09.078410 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7fe74528-31a5-40da-82cf-2d08bbf12de2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:09.078836 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7fe74528-31a5-40da-82cf-2d08bbf12de2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:09.207595 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7fe74528-31a5-40da-82cf-2d08bbf12de2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:09.215900 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7fe74528-31a5-40da-82cf-2d08bbf12de2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.150305 Nov 16 19:02:09.216467 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 55/115] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:09 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:09.601912 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-109dd163-6e6a-4711-b428-c160cd56bd03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 14 microversion: 2.1 time: 2.674251 Nov 16 19:02:09.605977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 61/116] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:06 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 14 bytes in 2676 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:10.233889 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-09c98d61-bdb8-493e-8cb4-ce05a2242765 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:10.234491 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-09c98d61-bdb8-493e-8cb4-ce05a2242765 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:10.242193 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09c98d61-bdb8-493e-8cb4-ce05a2242765 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:10.242715 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09c98d61-bdb8-493e-8cb4-ce05a2242765 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:10.243677 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09c98d61-bdb8-493e-8cb4-ce05a2242765 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:10.244464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09c98d61-bdb8-493e-8cb4-ce05a2242765 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:10.401853 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-09c98d61-bdb8-493e-8cb4-ce05a2242765 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:10.410989 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-09c98d61-bdb8-493e-8cb4-ce05a2242765 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.181052 Nov 16 19:02:10.411604 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 56/117] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:10 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:10.614654 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-752e0207-776f-4bb8-ba0e-4b9022552812 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:10.615681 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-752e0207-776f-4bb8-ba0e-4b9022552812 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:10.623278 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-752e0207-776f-4bb8-ba0e-4b9022552812 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:10.623728 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-752e0207-776f-4bb8-ba0e-4b9022552812 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:10.624509 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-752e0207-776f-4bb8-ba0e-4b9022552812 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:10.624944 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-752e0207-776f-4bb8-ba0e-4b9022552812 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:10.713318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-752e0207-776f-4bb8-ba0e-4b9022552812 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 14 microversion: 2.1 time: 0.103640 Nov 16 19:02:10.714265 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 62/118] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:10 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:10.737594 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bbcddb31-051c-4f1b-bf97-4f7e6faaeb50 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:10.738216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bbcddb31-051c-4f1b-bf97-4f7e6faaeb50 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:10.744531 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bbcddb31-051c-4f1b-bf97-4f7e6faaeb50 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:10.745308 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bbcddb31-051c-4f1b-bf97-4f7e6faaeb50 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:10.746198 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bbcddb31-051c-4f1b-bf97-4f7e6faaeb50 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:10.746658 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bbcddb31-051c-4f1b-bf97-4f7e6faaeb50 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:10.773186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bbcddb31-051c-4f1b-bf97-4f7e6faaeb50 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:02:10.865521 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bbcddb31-051c-4f1b-bf97-4f7e6faaeb50 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 204 len: 0 microversion: 2.1 time: 0.131270 Nov 16 19:02:10.866429 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 57/119] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:02:10 2021] DELETE /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:02:10.874954 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-93480329-246b-4ac3-9372-eff407e23c75 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:10.875744 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-93480329-246b-4ac3-9372-eff407e23c75 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:10.883391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-93480329-246b-4ac3-9372-eff407e23c75 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:10.883873 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-93480329-246b-4ac3-9372-eff407e23c75 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:10.884996 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-93480329-246b-4ac3-9372-eff407e23c75 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:10.885437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-93480329-246b-4ac3-9372-eff407e23c75 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:11.035645 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-93480329-246b-4ac3-9372-eff407e23c75 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:11.044098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-93480329-246b-4ac3-9372-eff407e23c75 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.173170 Nov 16 19:02:11.044666 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 63/120] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:10 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:11.428995 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-17c0acb9-4811-452e-b0ee-fbf2f95c449b tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:11.429788 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-17c0acb9-4811-452e-b0ee-fbf2f95c449b tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:11.436520 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17c0acb9-4811-452e-b0ee-fbf2f95c449b tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:11.437050 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17c0acb9-4811-452e-b0ee-fbf2f95c449b tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:11.437966 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17c0acb9-4811-452e-b0ee-fbf2f95c449b tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:11.438484 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17c0acb9-4811-452e-b0ee-fbf2f95c449b tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:11.626651 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-17c0acb9-4811-452e-b0ee-fbf2f95c449b tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:11.634480 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-17c0acb9-4811-452e-b0ee-fbf2f95c449b tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.210014 Nov 16 19:02:11.635306 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 58/121] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:11 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:11.724148 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3b972f1f-d4f7-40d5-a89d-e077f0ace295 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:11.725143 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3b972f1f-d4f7-40d5-a89d-e077f0ace295 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:11.732776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3b972f1f-d4f7-40d5-a89d-e077f0ace295 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:11.734427 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3b972f1f-d4f7-40d5-a89d-e077f0ace295 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:11.741453 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3b972f1f-d4f7-40d5-a89d-e077f0ace295 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:11.742054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3b972f1f-d4f7-40d5-a89d-e077f0ace295 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:12.113620 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d4837dca-3202-4a67-92d1-1052e5354358 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:12.114440 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d4837dca-3202-4a67-92d1-1052e5354358 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:12.122737 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4837dca-3202-4a67-92d1-1052e5354358 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:12.123199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4837dca-3202-4a67-92d1-1052e5354358 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:12.124141 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4837dca-3202-4a67-92d1-1052e5354358 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:12.124592 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4837dca-3202-4a67-92d1-1052e5354358 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:12.309723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d4837dca-3202-4a67-92d1-1052e5354358 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:12.322124 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d4837dca-3202-4a67-92d1-1052e5354358 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.212609 Nov 16 19:02:12.323118 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 59/122] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:12 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:12.651935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a4958e2f-b055-4e8a-9715-0fbcc17ec3a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:12.652806 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a4958e2f-b055-4e8a-9715-0fbcc17ec3a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:12.658717 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a4958e2f-b055-4e8a-9715-0fbcc17ec3a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:12.659168 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a4958e2f-b055-4e8a-9715-0fbcc17ec3a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:12.659941 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a4958e2f-b055-4e8a-9715-0fbcc17ec3a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:12.660376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a4958e2f-b055-4e8a-9715-0fbcc17ec3a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:12.797458 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a4958e2f-b055-4e8a-9715-0fbcc17ec3a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:12.805245 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a4958e2f-b055-4e8a-9715-0fbcc17ec3a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.156847 Nov 16 19:02:12.805853 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 60/123] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:12 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:13.338713 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-40660594-bb56-4849-9009-4223c27dc7c4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:13.340679 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-40660594-bb56-4849-9009-4223c27dc7c4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:13.348663 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40660594-bb56-4849-9009-4223c27dc7c4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:13.349194 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40660594-bb56-4849-9009-4223c27dc7c4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:13.350078 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40660594-bb56-4849-9009-4223c27dc7c4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:13.351118 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40660594-bb56-4849-9009-4223c27dc7c4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:13.485836 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-40660594-bb56-4849-9009-4223c27dc7c4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:13.493533 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-40660594-bb56-4849-9009-4223c27dc7c4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.158739 Nov 16 19:02:13.494118 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 61/124] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:13 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:13.822046 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8ac8bae9-339b-435a-8052-40f30d7b9e2c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:13.822653 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8ac8bae9-339b-435a-8052-40f30d7b9e2c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:13.829475 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8ac8bae9-339b-435a-8052-40f30d7b9e2c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:13.830132 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8ac8bae9-339b-435a-8052-40f30d7b9e2c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:13.831075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8ac8bae9-339b-435a-8052-40f30d7b9e2c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:13.831655 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8ac8bae9-339b-435a-8052-40f30d7b9e2c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:13.898363 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3b972f1f-d4f7-40d5-a89d-e077f0ace295 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 13651 microversion: 2.1 time: 2.177142 Nov 16 19:02:13.899062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 64/125] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:11 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 13651 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:13.982667 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8ac8bae9-339b-435a-8052-40f30d7b9e2c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:13.989787 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8ac8bae9-339b-435a-8052-40f30d7b9e2c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.171354 Nov 16 19:02:13.990339 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 62/126] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:13 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:14.511459 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e1e38039-15f2-43e2-a951-10130e59c525 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:14.512158 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e1e38039-15f2-43e2-a951-10130e59c525 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:14.519324 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e1e38039-15f2-43e2-a951-10130e59c525 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:14.519857 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e1e38039-15f2-43e2-a951-10130e59c525 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:14.520889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e1e38039-15f2-43e2-a951-10130e59c525 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:14.521326 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e1e38039-15f2-43e2-a951-10130e59c525 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:14.691575 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e1e38039-15f2-43e2-a951-10130e59c525 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:14.711702 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e1e38039-15f2-43e2-a951-10130e59c525 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.204821 Nov 16 19:02:14.712551 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 65/127] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:14 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:14.910071 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-46028bc2-acd1-41e6-a0a3-2b96145c18e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:14.911909 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-46028bc2-acd1-41e6-a0a3-2b96145c18e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:14.920070 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-46028bc2-acd1-41e6-a0a3-2b96145c18e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:14.920783 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-46028bc2-acd1-41e6-a0a3-2b96145c18e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:14.921792 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-46028bc2-acd1-41e6-a0a3-2b96145c18e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:14.923324 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-46028bc2-acd1-41e6-a0a3-2b96145c18e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:15.008881 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7ed1903b-adfc-4cf9-8c64-c0ea1467c8ab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:15.009487 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7ed1903b-adfc-4cf9-8c64-c0ea1467c8ab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:15.016691 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ed1903b-adfc-4cf9-8c64-c0ea1467c8ab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:15.017244 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ed1903b-adfc-4cf9-8c64-c0ea1467c8ab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:15.017930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ed1903b-adfc-4cf9-8c64-c0ea1467c8ab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:15.018562 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ed1903b-adfc-4cf9-8c64-c0ea1467c8ab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:15.186537 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7ed1903b-adfc-4cf9-8c64-c0ea1467c8ab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:15.193893 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7ed1903b-adfc-4cf9-8c64-c0ea1467c8ab tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.189710 Nov 16 19:02:15.194492 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 66/128] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:15 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:15.730749 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f3744d4c-d4a8-4d5b-9d70-2d586fef8ee2 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:15.731355 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f3744d4c-d4a8-4d5b-9d70-2d586fef8ee2 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:15.737907 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3744d4c-d4a8-4d5b-9d70-2d586fef8ee2 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:15.738370 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3744d4c-d4a8-4d5b-9d70-2d586fef8ee2 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:15.739232 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3744d4c-d4a8-4d5b-9d70-2d586fef8ee2 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:15.739740 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3744d4c-d4a8-4d5b-9d70-2d586fef8ee2 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:15.879667 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f3744d4c-d4a8-4d5b-9d70-2d586fef8ee2 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:15.887837 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f3744d4c-d4a8-4d5b-9d70-2d586fef8ee2 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.160698 Nov 16 19:02:15.888392 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 67/129] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:15 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:16.211116 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1280440d-4cdd-4bfb-8ea9-1247e14d1cf4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:16.211725 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1280440d-4cdd-4bfb-8ea9-1247e14d1cf4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:16.217922 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1280440d-4cdd-4bfb-8ea9-1247e14d1cf4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:16.218363 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1280440d-4cdd-4bfb-8ea9-1247e14d1cf4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:16.219141 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1280440d-4cdd-4bfb-8ea9-1247e14d1cf4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:16.219587 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1280440d-4cdd-4bfb-8ea9-1247e14d1cf4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:16.361819 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1280440d-4cdd-4bfb-8ea9-1247e14d1cf4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:16.371915 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1280440d-4cdd-4bfb-8ea9-1247e14d1cf4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.164309 Nov 16 19:02:16.372488 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 68/130] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:16 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:16.904550 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d06d702d-73c1-40b3-8edf-8c0d95555b08 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:16.905157 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d06d702d-73c1-40b3-8edf-8c0d95555b08 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:16.911295 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d06d702d-73c1-40b3-8edf-8c0d95555b08 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:16.911815 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d06d702d-73c1-40b3-8edf-8c0d95555b08 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:16.912490 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d06d702d-73c1-40b3-8edf-8c0d95555b08 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:16.913528 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d06d702d-73c1-40b3-8edf-8c0d95555b08 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:17.051766 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d06d702d-73c1-40b3-8edf-8c0d95555b08 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:17.060028 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d06d702d-73c1-40b3-8edf-8c0d95555b08 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.159378 Nov 16 19:02:17.060673 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 69/131] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:16 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:17.388901 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9f05aaee-d451-4481-94e5-51beae7e2991 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:17.389510 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9f05aaee-d451-4481-94e5-51beae7e2991 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:17.395969 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f05aaee-d451-4481-94e5-51beae7e2991 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:17.396412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f05aaee-d451-4481-94e5-51beae7e2991 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:17.397712 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f05aaee-d451-4481-94e5-51beae7e2991 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:17.398441 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f05aaee-d451-4481-94e5-51beae7e2991 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:17.576274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9f05aaee-d451-4481-94e5-51beae7e2991 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:17.583541 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9f05aaee-d451-4481-94e5-51beae7e2991 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.198783 Nov 16 19:02:17.584121 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 70/132] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:17 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:18.061478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-46028bc2-acd1-41e6-a0a3-2b96145c18e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 17808 microversion: 2.1 time: 3.155552 Nov 16 19:02:18.062169 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 63/133] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:14 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 17808 bytes in 3157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:02:18.077439 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b408a225-fdfa-4b84-abc5-560ee8149053 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:18.078179 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b408a225-fdfa-4b84-abc5-560ee8149053 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:18.083860 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b408a225-fdfa-4b84-abc5-560ee8149053 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:18.084309 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b408a225-fdfa-4b84-abc5-560ee8149053 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:18.085607 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b408a225-fdfa-4b84-abc5-560ee8149053 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:18.086039 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b408a225-fdfa-4b84-abc5-560ee8149053 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:18.218943 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b408a225-fdfa-4b84-abc5-560ee8149053 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:18.228706 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b408a225-fdfa-4b84-abc5-560ee8149053 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.154761 Nov 16 19:02:18.229293 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 71/134] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:18 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:18.600321 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ef96b36a-31c2-40bb-a491-9bcdfec96ceb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:18.601045 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ef96b36a-31c2-40bb-a491-9bcdfec96ceb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:18.607705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ef96b36a-31c2-40bb-a491-9bcdfec96ceb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:18.608148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ef96b36a-31c2-40bb-a491-9bcdfec96ceb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:18.608927 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ef96b36a-31c2-40bb-a491-9bcdfec96ceb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:18.609357 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ef96b36a-31c2-40bb-a491-9bcdfec96ceb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:18.742996 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ef96b36a-31c2-40bb-a491-9bcdfec96ceb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:18.751742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ef96b36a-31c2-40bb-a491-9bcdfec96ceb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.155422 Nov 16 19:02:18.752308 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 64/135] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:18 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:19.073940 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b1d13b7f-37b1-45b4-b1db-056a458b94de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:19.075031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b1d13b7f-37b1-45b4-b1db-056a458b94de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:19.081680 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b1d13b7f-37b1-45b4-b1db-056a458b94de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:19.082137 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b1d13b7f-37b1-45b4-b1db-056a458b94de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:19.082920 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b1d13b7f-37b1-45b4-b1db-056a458b94de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:19.083956 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b1d13b7f-37b1-45b4-b1db-056a458b94de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:19.248421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dfc70616-94db-47d7-89cc-450158610391 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:19.249158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dfc70616-94db-47d7-89cc-450158610391 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:19.255381 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfc70616-94db-47d7-89cc-450158610391 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:19.255831 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfc70616-94db-47d7-89cc-450158610391 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:19.257170 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfc70616-94db-47d7-89cc-450158610391 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:19.257570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfc70616-94db-47d7-89cc-450158610391 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:19.411717 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dfc70616-94db-47d7-89cc-450158610391 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:19.419554 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dfc70616-94db-47d7-89cc-450158610391 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.174922 Nov 16 19:02:19.420217 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 65/136] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:19 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:19.769465 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8d02e34c-300e-4544-9634-3897cc2600a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:19.770067 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8d02e34c-300e-4544-9634-3897cc2600a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:19.776327 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8d02e34c-300e-4544-9634-3897cc2600a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:19.776783 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8d02e34c-300e-4544-9634-3897cc2600a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:19.777591 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8d02e34c-300e-4544-9634-3897cc2600a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:19.778031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8d02e34c-300e-4544-9634-3897cc2600a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:19.918493 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8d02e34c-300e-4544-9634-3897cc2600a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:19.925654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8d02e34c-300e-4544-9634-3897cc2600a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.159928 Nov 16 19:02:19.929281 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 66/137] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:19 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:20.436034 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b582a6f7-5ed8-4712-b100-4880e0e6c3a9 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:20.436724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b582a6f7-5ed8-4712-b100-4880e0e6c3a9 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:20.443179 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b582a6f7-5ed8-4712-b100-4880e0e6c3a9 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:20.443630 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b582a6f7-5ed8-4712-b100-4880e0e6c3a9 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:20.444977 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b582a6f7-5ed8-4712-b100-4880e0e6c3a9 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:20.445410 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b582a6f7-5ed8-4712-b100-4880e0e6c3a9 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:20.581314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b582a6f7-5ed8-4712-b100-4880e0e6c3a9 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:20.589282 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b582a6f7-5ed8-4712-b100-4880e0e6c3a9 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.157072 Nov 16 19:02:20.589881 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 67/138] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:20 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:20.947828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eb646c1b-bd28-4b52-8551-206cf2df3ec2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:20.948655 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eb646c1b-bd28-4b52-8551-206cf2df3ec2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:20.954812 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb646c1b-bd28-4b52-8551-206cf2df3ec2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:20.955412 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb646c1b-bd28-4b52-8551-206cf2df3ec2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:20.956557 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb646c1b-bd28-4b52-8551-206cf2df3ec2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:20.957187 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb646c1b-bd28-4b52-8551-206cf2df3ec2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:21.097374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eb646c1b-bd28-4b52-8551-206cf2df3ec2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:21.105225 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eb646c1b-bd28-4b52-8551-206cf2df3ec2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.166176 Nov 16 19:02:21.105810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 68/139] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:20 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:21.605870 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7a85e636-7676-40a8-b503-3978d3d103da tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:21.606544 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7a85e636-7676-40a8-b503-3978d3d103da tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:21.612702 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a85e636-7676-40a8-b503-3978d3d103da tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:21.613180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a85e636-7676-40a8-b503-3978d3d103da tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:21.614027 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a85e636-7676-40a8-b503-3978d3d103da tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:21.614426 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a85e636-7676-40a8-b503-3978d3d103da tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:21.715775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b1d13b7f-37b1-45b4-b1db-056a458b94de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 23181 microversion: 2.1 time: 2.645281 Nov 16 19:02:21.716762 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 72/140] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:19 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 23181 bytes in 2647 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:21.743822 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7a85e636-7676-40a8-b503-3978d3d103da tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:21.751712 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7a85e636-7676-40a8-b503-3978d3d103da tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.149463 Nov 16 19:02:21.752286 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 69/141] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:21 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:22.122997 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c7ac1cdf-1bf3-45fe-b926-043c56768a74 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:22.123676 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c7ac1cdf-1bf3-45fe-b926-043c56768a74 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:22.130689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7ac1cdf-1bf3-45fe-b926-043c56768a74 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:22.131134 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7ac1cdf-1bf3-45fe-b926-043c56768a74 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:22.132422 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7ac1cdf-1bf3-45fe-b926-043c56768a74 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:22.132854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7ac1cdf-1bf3-45fe-b926-043c56768a74 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:22.270163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c7ac1cdf-1bf3-45fe-b926-043c56768a74 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:22.277702 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c7ac1cdf-1bf3-45fe-b926-043c56768a74 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.158854 Nov 16 19:02:22.278261 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 73/142] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:22 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:22.729808 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ba97e5ef-064b-49d0-8862-9f18b66b491a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:22.731233 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ba97e5ef-064b-49d0-8862-9f18b66b491a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:22.752149 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ba97e5ef-064b-49d0-8862-9f18b66b491a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:22.753324 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ba97e5ef-064b-49d0-8862-9f18b66b491a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:22.755000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ba97e5ef-064b-49d0-8862-9f18b66b491a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:22.755661 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ba97e5ef-064b-49d0-8862-9f18b66b491a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:22.769685 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5db734fa-cbbf-4d71-877b-a47a1ed895a8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:22.770936 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5db734fa-cbbf-4d71-877b-a47a1ed895a8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:22.782356 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5db734fa-cbbf-4d71-877b-a47a1ed895a8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:22.783210 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5db734fa-cbbf-4d71-877b-a47a1ed895a8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:22.785144 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5db734fa-cbbf-4d71-877b-a47a1ed895a8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:22.790576 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5db734fa-cbbf-4d71-877b-a47a1ed895a8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:22.854933 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ba97e5ef-064b-49d0-8862-9f18b66b491a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 23804 microversion: 2.1 time: 0.130872 Nov 16 19:02:22.855569 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 70/143] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:22 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 23804 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:23.118369 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5db734fa-cbbf-4d71-877b-a47a1ed895a8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:23.126948 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5db734fa-cbbf-4d71-877b-a47a1ed895a8 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1553 microversion: 2.1 time: 0.361259 Nov 16 19:02:23.127511 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 74/144] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:22 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:23.294707 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2d72926a-95f6-45ed-85fa-b8cd12732ab1 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:23.295397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2d72926a-95f6-45ed-85fa-b8cd12732ab1 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:23.307454 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2d72926a-95f6-45ed-85fa-b8cd12732ab1 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:23.307902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2d72926a-95f6-45ed-85fa-b8cd12732ab1 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:23.308703 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2d72926a-95f6-45ed-85fa-b8cd12732ab1 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:23.309318 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2d72926a-95f6-45ed-85fa-b8cd12732ab1 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:23.504408 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-c678b520-2024-4741-a416-6894981d65bf req-e99dd1c7-efe1-41cd-b5c3-fc83f0a54cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8df9df9-abb5-47f5-ba35-590c9d13ef80", "name": "network-vif-deleted", "tag": "80c2bad8-ab54-4cb0-8aa8-cb0d47a28f5d"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:23.506534 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:02:23.506534 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:02:23.516054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-c678b520-2024-4741-a416-6894981d65bf req-e99dd1c7-efe1-41cd-b5c3-fc83f0a54cf1 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:23.516684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-c678b520-2024-4741-a416-6894981d65bf req-e99dd1c7-efe1-41cd-b5c3-fc83f0a54cf1 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:23.535068 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-c678b520-2024-4741-a416-6894981d65bf req-e99dd1c7-efe1-41cd-b5c3-fc83f0a54cf1 service nova] Creating event network-vif-deleted:80c2bad8-ab54-4cb0-8aa8-cb0d47a28f5d for instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 on hv-cinder-66710 Nov 16 19:02:23.546886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-c678b520-2024-4741-a416-6894981d65bf req-e99dd1c7-efe1-41cd-b5c3-fc83f0a54cf1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047127 Nov 16 19:02:23.547908 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 75/145] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:02:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:02:23.669046 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2d72926a-95f6-45ed-85fa-b8cd12732ab1 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:23.676814 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2d72926a-95f6-45ed-85fa-b8cd12732ab1 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.385894 Nov 16 19:02:23.677480 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 71/146] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:23 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:23.868399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-363bf1c2-2187-4af4-8c49-60efb20ac125 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:23.872681 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-363bf1c2-2187-4af4-8c49-60efb20ac125 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:23.885655 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-363bf1c2-2187-4af4-8c49-60efb20ac125 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:23.886103 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-363bf1c2-2187-4af4-8c49-60efb20ac125 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:23.887738 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-363bf1c2-2187-4af4-8c49-60efb20ac125 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:23.891936 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-363bf1c2-2187-4af4-8c49-60efb20ac125 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:23.987873 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-363bf1c2-2187-4af4-8c49-60efb20ac125 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 24995 microversion: 2.1 time: 0.123652 Nov 16 19:02:23.992394 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 76/147] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:23 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 24995 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:24.144265 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:24.144865 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:24.152761 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:24.153612 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:24.154536 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:24.155129 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:24.200616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:24.200616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:24.200616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lazy-loading 'fault' on Instance uuid e8df9df9-abb5-47f5-ba35-590c9d13ef80 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:02:24.262295 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46ac557e7ae54b73840960ef2b56b871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb8ecf530f404e9588c2db9f9a4ba148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:24.273241 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-85fed4a4-290b-4ec4-ba82-2f349ae026d4 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 200 len: 1351 microversion: 2.1 time: 0.132792 Nov 16 19:02:24.274039 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 72/148] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:24 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 1351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:24.695547 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f448c7cd-26e7-4576-b2ee-362c0fdaadcf tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:24.696246 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f448c7cd-26e7-4576-b2ee-362c0fdaadcf tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:24.708249 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f448c7cd-26e7-4576-b2ee-362c0fdaadcf tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:24.708740 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f448c7cd-26e7-4576-b2ee-362c0fdaadcf tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:24.712437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f448c7cd-26e7-4576-b2ee-362c0fdaadcf tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:24.714029 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f448c7cd-26e7-4576-b2ee-362c0fdaadcf tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:24.982395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f448c7cd-26e7-4576-b2ee-362c0fdaadcf tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:24.992825 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f448c7cd-26e7-4576-b2ee-362c0fdaadcf tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.302428 Nov 16 19:02:25.002307 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 77/149] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:24 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:25.005486 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1e65d5ce-2aa1-4ae9-8126-689e8a78540c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:25.006558 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1e65d5ce-2aa1-4ae9-8126-689e8a78540c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:25.026988 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e65d5ce-2aa1-4ae9-8126-689e8a78540c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:25.027442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e65d5ce-2aa1-4ae9-8126-689e8a78540c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:25.028323 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e65d5ce-2aa1-4ae9-8126-689e8a78540c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:25.028654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e65d5ce-2aa1-4ae9-8126-689e8a78540c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:25.127514 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1e65d5ce-2aa1-4ae9-8126-689e8a78540c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 26010 microversion: 2.1 time: 0.130755 Nov 16 19:02:25.128522 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 73/150] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:24 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 26010 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:25.290912 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:25.291804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:25.300100 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:25.301133 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:25.302338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:25.303003 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:25.320495 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] HTTP exception thrown: Instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 could not be found. Nov 16 19:02:25.321368 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Returning 404 to user: Instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:02:25.322236 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6f9840a9-d170-474e-912a-25ba09cf965c tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 404 len: 111 microversion: 2.1 time: 0.035351 Nov 16 19:02:25.324714 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 78/151] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:25 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:02:25.477461 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:25.478522 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:25.487371 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:25.487820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:25.488609 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:25.494340 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:25.515705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] HTTP exception thrown: Instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 could not be found. Nov 16 19:02:25.516321 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Returning 404 to user: Instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:02:25.517353 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-86df4843-ca3e-4a8b-9d1b-e72b42952628 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043980 Nov 16 19:02:25.518119 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 74/152] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:02:25 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:02:26.011467 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c96faaec-0a37-41a9-91dc-1a69e58b9375 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:26.012337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c96faaec-0a37-41a9-91dc-1a69e58b9375 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:26.036684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c96faaec-0a37-41a9-91dc-1a69e58b9375 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:26.036684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c96faaec-0a37-41a9-91dc-1a69e58b9375 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:26.040577 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c96faaec-0a37-41a9-91dc-1a69e58b9375 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:26.041293 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c96faaec-0a37-41a9-91dc-1a69e58b9375 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:26.143829 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cb929c31-baf3-4a74-b493-2d1902640d4e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:26.145101 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cb929c31-baf3-4a74-b493-2d1902640d4e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:26.151485 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb929c31-baf3-4a74-b493-2d1902640d4e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:26.152275 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb929c31-baf3-4a74-b493-2d1902640d4e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:26.153660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb929c31-baf3-4a74-b493-2d1902640d4e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:26.154684 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb929c31-baf3-4a74-b493-2d1902640d4e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:26.275095 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cb929c31-baf3-4a74-b493-2d1902640d4e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 26913 microversion: 2.1 time: 0.135807 Nov 16 19:02:26.279878 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 75/153] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:26 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 26913 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:26.282745 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c96faaec-0a37-41a9-91dc-1a69e58b9375 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:26.307821 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c96faaec-0a37-41a9-91dc-1a69e58b9375 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.301381 Nov 16 19:02:26.310478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 79/154] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:26 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:26.748772 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:26.757206 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:26.760479 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:26.761447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:26.762721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:26.763534 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:26.779400 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] HTTP exception thrown: Instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 could not be found. Nov 16 19:02:26.779843 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Returning 404 to user: Instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:02:26.780671 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-96c82396-3ee9-4adc-9168-52ccf01850a3 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 404 len: 111 microversion: 2.1 time: 0.036831 Nov 16 19:02:26.781230 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 76/155] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:02:26 2021] DELETE /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:02:26.789196 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:26.789872 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] [instance: e8df9df9-abb5-47f5-ba35-590c9d13ef80] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:26.796054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:26.796711 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:26.797609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:26.798265 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:26.811824 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] HTTP exception thrown: Instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 could not be found. Nov 16 19:02:26.812571 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] Returning 404 to user: Instance e8df9df9-abb5-47f5-ba35-590c9d13ef80 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:02:26.813467 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-68ef421a-cec8-4e7e-bba8-d2d0af899fc7 tempest-DeleteServersTestJSON-1342294164 tempest-DeleteServersTestJSON-1342294164-project] 10.222.0.46 "GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80" status: 404 len: 111 microversion: 2.1 time: 0.028135 Nov 16 19:02:26.814136 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 80/156] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:26 2021] GET /compute/v2.1/servers/e8df9df9-abb5-47f5-ba35-590c9d13ef80 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:02:27.287583 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c790815e-d7d6-4d00-8c8f-ed079ad8bffe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:27.288647 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c790815e-d7d6-4d00-8c8f-ed079ad8bffe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:27.298765 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c790815e-d7d6-4d00-8c8f-ed079ad8bffe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:27.302274 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c790815e-d7d6-4d00-8c8f-ed079ad8bffe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:27.304020 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c790815e-d7d6-4d00-8c8f-ed079ad8bffe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:27.306061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c790815e-d7d6-4d00-8c8f-ed079ad8bffe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:27.324388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1c7d8173-605d-4df1-b951-5809ac781b8c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:27.324994 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1c7d8173-605d-4df1-b951-5809ac781b8c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:27.331249 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1c7d8173-605d-4df1-b951-5809ac781b8c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:27.342178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1c7d8173-605d-4df1-b951-5809ac781b8c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:27.343024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1c7d8173-605d-4df1-b951-5809ac781b8c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:27.343460 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1c7d8173-605d-4df1-b951-5809ac781b8c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:27.436084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c790815e-d7d6-4d00-8c8f-ed079ad8bffe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 27530 microversion: 2.1 time: 0.152190 Nov 16 19:02:27.436736 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 77/157] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:27 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 27530 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:27.670918 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1c7d8173-605d-4df1-b951-5809ac781b8c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:27.682409 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1c7d8173-605d-4df1-b951-5809ac781b8c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.361431 Nov 16 19:02:27.682978 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 81/158] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:27 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:28.450295 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-07a7addf-1270-4fd1-96c0-58f8e1ebdf9e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:28.452346 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-07a7addf-1270-4fd1-96c0-58f8e1ebdf9e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:28.460839 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07a7addf-1270-4fd1-96c0-58f8e1ebdf9e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:28.461608 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07a7addf-1270-4fd1-96c0-58f8e1ebdf9e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:28.462377 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07a7addf-1270-4fd1-96c0-58f8e1ebdf9e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:28.462878 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07a7addf-1270-4fd1-96c0-58f8e1ebdf9e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:28.699589 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f4096a42-f366-4388-b2c5-052328ae9fbc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:28.700359 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f4096a42-f366-4388-b2c5-052328ae9fbc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:28.707342 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f4096a42-f366-4388-b2c5-052328ae9fbc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:28.707788 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f4096a42-f366-4388-b2c5-052328ae9fbc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:28.708556 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f4096a42-f366-4388-b2c5-052328ae9fbc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:28.708981 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f4096a42-f366-4388-b2c5-052328ae9fbc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:28.849470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f4096a42-f366-4388-b2c5-052328ae9fbc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:28.858673 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f4096a42-f366-4388-b2c5-052328ae9fbc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.162670 Nov 16 19:02:28.859767 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 82/159] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:28 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:29.875892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5c51e8f5-0129-444f-86ed-9320cb4c1957 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:29.876732 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5c51e8f5-0129-444f-86ed-9320cb4c1957 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:29.887790 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c51e8f5-0129-444f-86ed-9320cb4c1957 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:29.887790 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c51e8f5-0129-444f-86ed-9320cb4c1957 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:29.887790 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c51e8f5-0129-444f-86ed-9320cb4c1957 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:29.887790 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c51e8f5-0129-444f-86ed-9320cb4c1957 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:30.222483 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5c51e8f5-0129-444f-86ed-9320cb4c1957 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:30.233698 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5c51e8f5-0129-444f-86ed-9320cb4c1957 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.361295 Nov 16 19:02:30.235316 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 83/160] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:29 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:30.620176 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-07a7addf-1270-4fd1-96c0-58f8e1ebdf9e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 27829 microversion: 2.1 time: 2.175486 Nov 16 19:02:30.628004 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 78/161] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:28 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 27829 bytes in 2185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:31.261813 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f4278b7a-2d83-4c2f-bb28-ccb7408c1ad5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:31.263488 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f4278b7a-2d83-4c2f-bb28-ccb7408c1ad5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:31.272451 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f4278b7a-2d83-4c2f-bb28-ccb7408c1ad5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:31.273086 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f4278b7a-2d83-4c2f-bb28-ccb7408c1ad5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:31.274519 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f4278b7a-2d83-4c2f-bb28-ccb7408c1ad5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:31.274969 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f4278b7a-2d83-4c2f-bb28-ccb7408c1ad5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:31.641303 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dd894445-1745-4070-9cd0-c059cfb34abf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:31.643368 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dd894445-1745-4070-9cd0-c059cfb34abf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:31.653370 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd894445-1745-4070-9cd0-c059cfb34abf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:31.654147 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd894445-1745-4070-9cd0-c059cfb34abf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:31.655184 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd894445-1745-4070-9cd0-c059cfb34abf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:31.657418 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd894445-1745-4070-9cd0-c059cfb34abf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:31.665525 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f4278b7a-2d83-4c2f-bb28-ccb7408c1ad5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:31.678704 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f4278b7a-2d83-4c2f-bb28-ccb7408c1ad5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.422707 Nov 16 19:02:31.679285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 84/162] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:31 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:31.765644 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dd894445-1745-4070-9cd0-c059cfb34abf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28191 microversion: 2.1 time: 0.132102 Nov 16 19:02:31.766521 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 79/163] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:31 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28191 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:32.696130 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f381990f-8cf8-49fc-b3a0-47147a823449 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:32.696742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f381990f-8cf8-49fc-b3a0-47147a823449 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:32.703538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f381990f-8cf8-49fc-b3a0-47147a823449 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:32.703983 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f381990f-8cf8-49fc-b3a0-47147a823449 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:32.704755 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f381990f-8cf8-49fc-b3a0-47147a823449 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:32.705370 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f381990f-8cf8-49fc-b3a0-47147a823449 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:32.779214 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e0e1f5c6-ac65-4870-9666-29c3f257d17d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:32.781014 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e0e1f5c6-ac65-4870-9666-29c3f257d17d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:32.793439 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0e1f5c6-ac65-4870-9666-29c3f257d17d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:32.794207 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0e1f5c6-ac65-4870-9666-29c3f257d17d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:32.795219 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0e1f5c6-ac65-4870-9666-29c3f257d17d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:32.796326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0e1f5c6-ac65-4870-9666-29c3f257d17d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:32.919615 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f381990f-8cf8-49fc-b3a0-47147a823449 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:32.929051 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f381990f-8cf8-49fc-b3a0-47147a823449 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.237012 Nov 16 19:02:32.930167 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 85/164] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:32 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:34.014382 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-28c9b2be-280f-4158-922b-af12e76489e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'create', calling method: .version_select at 0x7ffa576c1d30>, body: {"keypair": {"name": "tempest-keypair-186012312"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:34.038319 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-28c9b2be-280f-4158-922b-af12e76489e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:02:34.042379 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-28c9b2be-280f-4158-922b-af12e76489e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for user bc21495c8b60405194f1a6ea2de3e9e7 and project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:02:34.362698 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-28c9b2be-280f-4158-922b-af12e76489e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:02:34.362698 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-28c9b2be-280f-4158-922b-af12e76489e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for user bc21495c8b60405194f1a6ea2de3e9e7 and project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:02:34.377892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-28c9b2be-280f-4158-922b-af12e76489e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.503418 Nov 16 19:02:34.378444 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 86/165] 10.222.0.46 () {62 vars in 1198 bytes} [Tue Nov 16 19:02:33 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 505 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 16 19:02:34.383919 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-89e37189-e2dc-47ee-afba-3676065086a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:34.383919 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-89e37189-e2dc-47ee-afba-3676065086a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:34.390107 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89e37189-e2dc-47ee-afba-3676065086a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:34.390555 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89e37189-e2dc-47ee-afba-3676065086a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:34.391352 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89e37189-e2dc-47ee-afba-3676065086a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:34.391754 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89e37189-e2dc-47ee-afba-3676065086a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:34.597164 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-89e37189-e2dc-47ee-afba-3676065086a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:34.610058 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-89e37189-e2dc-47ee-afba-3676065086a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.230408 Nov 16 19:02:34.611046 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 87/166] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:34 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:34.952607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e0e1f5c6-ac65-4870-9666-29c3f257d17d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28191 microversion: 2.1 time: 2.177286 Nov 16 19:02:34.954526 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 80/167] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:32 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28191 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:35.628059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fb0b8c40-e2d9-4742-beb4-8f9a43217433 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:35.629269 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fb0b8c40-e2d9-4742-beb4-8f9a43217433 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:35.636652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb0b8c40-e2d9-4742-beb4-8f9a43217433 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:35.637305 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb0b8c40-e2d9-4742-beb4-8f9a43217433 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:35.638107 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb0b8c40-e2d9-4742-beb4-8f9a43217433 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:35.638688 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb0b8c40-e2d9-4742-beb4-8f9a43217433 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:35.944644 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fb0b8c40-e2d9-4742-beb4-8f9a43217433 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:35.956088 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fb0b8c40-e2d9-4742-beb4-8f9a43217433 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.331607 Nov 16 19:02:35.956669 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 88/168] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:35 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:35.966603 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4853a4fb-d205-403a-9e2c-5f5b212f2b2d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:35.968269 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4853a4fb-d205-403a-9e2c-5f5b212f2b2d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:35.976840 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4853a4fb-d205-403a-9e2c-5f5b212f2b2d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:35.977425 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4853a4fb-d205-403a-9e2c-5f5b212f2b2d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:35.978414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4853a4fb-d205-403a-9e2c-5f5b212f2b2d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:35.979254 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4853a4fb-d205-403a-9e2c-5f5b212f2b2d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:35.999619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-579321783", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56c01722-be30-4639-862d-514173b6757f"}], "security_groups": [{"name": "tempest-securitygroup--1822993852"}], "key_name": "tempest-keypair-186012312", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:38.297912 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4853a4fb-d205-403a-9e2c-5f5b212f2b2d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28191 microversion: 2.1 time: 2.335360 Nov 16 19:02:38.298618 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 81/169] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:35 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28191 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:38.304971 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1af1d10f-9e2d-4f68-b9b1-294692943a5d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:38.306362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1af1d10f-9e2d-4f68-b9b1-294692943a5d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:38.315998 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1af1d10f-9e2d-4f68-b9b1-294692943a5d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:38.316439 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1af1d10f-9e2d-4f68-b9b1-294692943a5d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:38.317204 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1af1d10f-9e2d-4f68-b9b1-294692943a5d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:38.317659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1af1d10f-9e2d-4f68-b9b1-294692943a5d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:38.452442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1af1d10f-9e2d-4f68-b9b1-294692943a5d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:38.459729 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1af1d10f-9e2d-4f68-b9b1-294692943a5d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.159918 Nov 16 19:02:38.460284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 82/170] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:38 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:39.309041 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7dcc332d-0765-4755-89f2-0e0186bad3a8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:39.310237 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7dcc332d-0765-4755-89f2-0e0186bad3a8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:39.316447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dcc332d-0765-4755-89f2-0e0186bad3a8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:39.316892 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dcc332d-0765-4755-89f2-0e0186bad3a8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:39.317692 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dcc332d-0765-4755-89f2-0e0186bad3a8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:39.318160 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dcc332d-0765-4755-89f2-0e0186bad3a8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:39.387229 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7dcc332d-0765-4755-89f2-0e0186bad3a8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28191 microversion: 2.1 time: 0.081463 Nov 16 19:02:39.387869 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 83/171] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:39 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:02:39.477823 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d3d13f3f-98e6-4389-bc1d-ca90385aa58f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:39.478539 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d3d13f3f-98e6-4389-bc1d-ca90385aa58f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:39.487332 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3d13f3f-98e6-4389-bc1d-ca90385aa58f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:39.487819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3d13f3f-98e6-4389-bc1d-ca90385aa58f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:39.488656 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3d13f3f-98e6-4389-bc1d-ca90385aa58f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:39.489112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3d13f3f-98e6-4389-bc1d-ca90385aa58f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:39.629364 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d3d13f3f-98e6-4389-bc1d-ca90385aa58f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:39.637352 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d3d13f3f-98e6-4389-bc1d-ca90385aa58f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.164557 Nov 16 19:02:39.637945 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 84/172] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:39 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:40.407115 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d856bdd4-c693-4889-8ade-308ab33800c9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:40.408036 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d856bdd4-c693-4889-8ade-308ab33800c9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:40.414903 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d856bdd4-c693-4889-8ade-308ab33800c9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:40.415339 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d856bdd4-c693-4889-8ade-308ab33800c9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:40.416109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d856bdd4-c693-4889-8ade-308ab33800c9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:40.416536 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d856bdd4-c693-4889-8ade-308ab33800c9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:40.511259 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d856bdd4-c693-4889-8ade-308ab33800c9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28316 microversion: 2.1 time: 0.107865 Nov 16 19:02:40.512557 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 85/173] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:40 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28316 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:40.655633 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-71599203-49af-495c-af29-bce4f4eb0467 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:40.655828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-71599203-49af-495c-af29-bce4f4eb0467 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:40.662631 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-71599203-49af-495c-af29-bce4f4eb0467 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:40.663098 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-71599203-49af-495c-af29-bce4f4eb0467 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:40.664490 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-71599203-49af-495c-af29-bce4f4eb0467 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:40.664921 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-71599203-49af-495c-af29-bce4f4eb0467 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:40.803122 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-71599203-49af-495c-af29-bce4f4eb0467 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:40.810635 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-71599203-49af-495c-af29-bce4f4eb0467 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.159418 Nov 16 19:02:40.811206 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 86/174] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:40 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:41.525691 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ed9052f4-7e02-4cc1-8c8f-668652186c4c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:41.527269 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ed9052f4-7e02-4cc1-8c8f-668652186c4c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:41.538938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ed9052f4-7e02-4cc1-8c8f-668652186c4c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:41.540156 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ed9052f4-7e02-4cc1-8c8f-668652186c4c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:41.541393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ed9052f4-7e02-4cc1-8c8f-668652186c4c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:41.542229 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ed9052f4-7e02-4cc1-8c8f-668652186c4c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:41.628298 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ed9052f4-7e02-4cc1-8c8f-668652186c4c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28482 microversion: 2.1 time: 0.108004 Nov 16 19:02:41.628942 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 87/175] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:41 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28482 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:02:41.829226 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f81757ee-57d1-4e4f-931b-31fca6ebc8d0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:41.829980 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f81757ee-57d1-4e4f-931b-31fca6ebc8d0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:41.837420 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f81757ee-57d1-4e4f-931b-31fca6ebc8d0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:41.838220 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f81757ee-57d1-4e4f-931b-31fca6ebc8d0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:41.839602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f81757ee-57d1-4e4f-931b-31fca6ebc8d0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:41.840646 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f81757ee-57d1-4e4f-931b-31fca6ebc8d0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:42.015260 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f81757ee-57d1-4e4f-931b-31fca6ebc8d0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:42.023434 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f81757ee-57d1-4e4f-931b-31fca6ebc8d0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.198598 Nov 16 19:02:42.024017 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 88/176] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:41 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:42.640250 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8f9355e4-cb6e-42cc-9596-acc917147088 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:42.641173 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8f9355e4-cb6e-42cc-9596-acc917147088 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:42.648271 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f9355e4-cb6e-42cc-9596-acc917147088 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:42.648845 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f9355e4-cb6e-42cc-9596-acc917147088 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:42.649834 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f9355e4-cb6e-42cc-9596-acc917147088 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:42.650279 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f9355e4-cb6e-42cc-9596-acc917147088 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:45.103822 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8f9355e4-cb6e-42cc-9596-acc917147088 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28482 microversion: 2.1 time: 2.466968 Nov 16 19:02:45.105626 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 89/177] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:42 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28482 bytes in 2470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:45.111634 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-781edd57-2cb6-410f-885d-a14ae27ec7a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:45.112520 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-781edd57-2cb6-410f-885d-a14ae27ec7a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:45.121364 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-781edd57-2cb6-410f-885d-a14ae27ec7a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:45.121852 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-781edd57-2cb6-410f-885d-a14ae27ec7a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:45.122653 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-781edd57-2cb6-410f-885d-a14ae27ec7a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:45.123076 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-781edd57-2cb6-410f-885d-a14ae27ec7a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:45.267948 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-781edd57-2cb6-410f-885d-a14ae27ec7a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:45.275913 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-781edd57-2cb6-410f-885d-a14ae27ec7a3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.168886 Nov 16 19:02:45.276574 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 90/178] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:45 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:46.116579 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5013ec30-bada-4430-82b7-5a154d21f7b5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:46.117639 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5013ec30-bada-4430-82b7-5a154d21f7b5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:46.124093 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5013ec30-bada-4430-82b7-5a154d21f7b5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:46.124545 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5013ec30-bada-4430-82b7-5a154d21f7b5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:46.125329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5013ec30-bada-4430-82b7-5a154d21f7b5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:46.125819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5013ec30-bada-4430-82b7-5a154d21f7b5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:46.221616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5013ec30-bada-4430-82b7-5a154d21f7b5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28649 microversion: 2.1 time: 0.107383 Nov 16 19:02:46.221616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 91/179] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:46 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28649 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:02:46.294196 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0c903661-a28c-422e-95c5-d84a00bebfa7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:46.294996 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0c903661-a28c-422e-95c5-d84a00bebfa7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:46.302244 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0c903661-a28c-422e-95c5-d84a00bebfa7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:46.302693 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0c903661-a28c-422e-95c5-d84a00bebfa7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:46.303492 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0c903661-a28c-422e-95c5-d84a00bebfa7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:46.303934 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0c903661-a28c-422e-95c5-d84a00bebfa7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:46.451478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0c903661-a28c-422e-95c5-d84a00bebfa7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:46.459756 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0c903661-a28c-422e-95c5-d84a00bebfa7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.169092 Nov 16 19:02:46.460682 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 92/180] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:46 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:47.232159 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0b85c8b8-d4eb-4212-9585-6572d39ad4c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:47.233101 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0b85c8b8-d4eb-4212-9585-6572d39ad4c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:47.239398 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0b85c8b8-d4eb-4212-9585-6572d39ad4c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:47.239855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0b85c8b8-d4eb-4212-9585-6572d39ad4c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:47.240641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0b85c8b8-d4eb-4212-9585-6572d39ad4c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:47.241653 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0b85c8b8-d4eb-4212-9585-6572d39ad4c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:47.323703 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0b85c8b8-d4eb-4212-9585-6572d39ad4c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28649 microversion: 2.1 time: 0.095119 Nov 16 19:02:47.324310 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 93/181] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:47 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28649 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:02:47.477731 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1fcd0441-7728-425a-b6ab-7b982565d01d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:47.478433 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1fcd0441-7728-425a-b6ab-7b982565d01d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:47.479947 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] validate_networks() for [('56c01722-be30-4639-862d-514173b6757f', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:02:47.486626 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1fcd0441-7728-425a-b6ab-7b982565d01d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:47.487084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1fcd0441-7728-425a-b6ab-7b982565d01d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:47.487868 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1fcd0441-7728-425a-b6ab-7b982565d01d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:47.488296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1fcd0441-7728-425a-b6ab-7b982565d01d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:47.652197 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1fcd0441-7728-425a-b6ab-7b982565d01d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:47.665627 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1fcd0441-7728-425a-b6ab-7b982565d01d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.191718 Nov 16 19:02:47.666874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 94/182] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:47 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:47.910048 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:02:47.910466 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:02:47.911251 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:02:47.911658 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:02:47.912210 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:02:47.922410 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:47.922783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:47.923596 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:47.924036 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:47.941580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:02:47.945772 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for user bc21495c8b60405194f1a6ea2de3e9e7 and project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:02:47.956478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:02:47.958843 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:02:48.011098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fcb7094b-6843-4511-b526-7bcab6a916ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 12.017080 Nov 16 19:02:48.011747 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 89/183] 10.222.0.46 () {62 vars in 1187 bytes} [Tue Nov 16 19:02:35 2021] POST /compute/v2.1/servers => generated 402 bytes in 12018 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 16 19:02:48.022865 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6cb812fc-bf8e-46a3-9108-cec74be0605f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:48.023520 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6cb812fc-bf8e-46a3-9108-cec74be0605f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:48.078460 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6cb812fc-bf8e-46a3-9108-cec74be0605f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:48.087899 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6cb812fc-bf8e-46a3-9108-cec74be0605f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:48.089442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6cb812fc-bf8e-46a3-9108-cec74be0605f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:48.091924 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6cb812fc-bf8e-46a3-9108-cec74be0605f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1280 microversion: 2.20 time: 0.073480 Nov 16 19:02:48.092735 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 95/184] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:48 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:48.336549 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7be74849-83a2-4aa8-bf25-7daf83a6ff65 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:48.337568 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7be74849-83a2-4aa8-bf25-7daf83a6ff65 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:48.347609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7be74849-83a2-4aa8-bf25-7daf83a6ff65 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:48.347609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7be74849-83a2-4aa8-bf25-7daf83a6ff65 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:48.347609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7be74849-83a2-4aa8-bf25-7daf83a6ff65 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:48.347609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7be74849-83a2-4aa8-bf25-7daf83a6ff65 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:48.415722 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7be74849-83a2-4aa8-bf25-7daf83a6ff65 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28649 microversion: 2.1 time: 0.083829 Nov 16 19:02:48.420357 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 90/185] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:48 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28649 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:48.685376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e076857f-aa78-49c1-9ede-67038091edf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:48.686016 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e076857f-aa78-49c1-9ede-67038091edf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:48.696678 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e076857f-aa78-49c1-9ede-67038091edf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:48.697234 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e076857f-aa78-49c1-9ede-67038091edf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:48.698137 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e076857f-aa78-49c1-9ede-67038091edf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:48.698679 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e076857f-aa78-49c1-9ede-67038091edf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:48.844629 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e076857f-aa78-49c1-9ede-67038091edf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:48.861481 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e076857f-aa78-49c1-9ede-67038091edf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.180459 Nov 16 19:02:48.862329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 96/186] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:48 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:49.112555 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:49.113248 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:49.120640 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:49.121083 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:49.121886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:49.122319 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:49.181974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:49.190025 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:49.191519 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:49.192607 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e9d8c583-f05a-4fc3-9cbd-0a8839c95656 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1332 microversion: 2.20 time: 0.084237 Nov 16 19:02:49.193161 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 91/187] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:49 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1332 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:49.427181 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8efe68f9-0835-449d-8c64-a3b3368b867b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:49.428135 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8efe68f9-0835-449d-8c64-a3b3368b867b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:49.435094 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8efe68f9-0835-449d-8c64-a3b3368b867b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:49.435539 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8efe68f9-0835-449d-8c64-a3b3368b867b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:49.436305 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8efe68f9-0835-449d-8c64-a3b3368b867b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:49.436737 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8efe68f9-0835-449d-8c64-a3b3368b867b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:49.514537 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8efe68f9-0835-449d-8c64-a3b3368b867b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28649 microversion: 2.1 time: 0.090733 Nov 16 19:02:49.515864 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 97/188] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:49 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28649 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:49.880643 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-52338c39-2910-4713-aa61-957f93363bcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:49.881250 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-52338c39-2910-4713-aa61-957f93363bcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:49.888720 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-52338c39-2910-4713-aa61-957f93363bcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:49.889427 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-52338c39-2910-4713-aa61-957f93363bcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:49.890509 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-52338c39-2910-4713-aa61-957f93363bcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:49.890952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-52338c39-2910-4713-aa61-957f93363bcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:50.128074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-52338c39-2910-4713-aa61-957f93363bcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:50.139453 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-52338c39-2910-4713-aa61-957f93363bcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1521 microversion: 2.1 time: 0.262407 Nov 16 19:02:50.140209 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 92/189] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:49 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:50.213475 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:50.214283 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:50.220939 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:50.221684 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:50.222829 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:50.224010 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:50.333011 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:50.381091 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:50.383094 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:50.384754 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-68845e1f-469b-4989-af0d-b946f0a9854c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1338 microversion: 2.20 time: 0.176889 Nov 16 19:02:50.385757 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 98/190] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:50 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1338 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:50.528721 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-63cec8fc-aca5-440c-b189-0448e77c9b11 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:50.530551 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-63cec8fc-aca5-440c-b189-0448e77c9b11 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:50.541372 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-63cec8fc-aca5-440c-b189-0448e77c9b11 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:50.541918 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-63cec8fc-aca5-440c-b189-0448e77c9b11 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:50.543048 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-63cec8fc-aca5-440c-b189-0448e77c9b11 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:50.543559 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-63cec8fc-aca5-440c-b189-0448e77c9b11 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:50.652047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-63cec8fc-aca5-440c-b189-0448e77c9b11 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28649 microversion: 2.1 time: 0.128601 Nov 16 19:02:50.653257 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 93/191] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:50 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28649 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:51.158475 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3ff321d5-a016-4526-ac6b-0afb0b6294e4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:51.159146 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3ff321d5-a016-4526-ac6b-0afb0b6294e4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:51.166724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ff321d5-a016-4526-ac6b-0afb0b6294e4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.167548 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ff321d5-a016-4526-ac6b-0afb0b6294e4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.168518 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ff321d5-a016-4526-ac6b-0afb0b6294e4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.168952 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ff321d5-a016-4526-ac6b-0afb0b6294e4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.249571 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-94c242be-7864-4180-9fe2-82b56702874f req-eb88da64-f169-422b-94aa-d5b3e947dee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b188c4dd-b4cc-4a02-9ea4-901009c68534", "tag": "3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:51.251737 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:02:51.251737 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:02:51.270459 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-94c242be-7864-4180-9fe2-82b56702874f req-eb88da64-f169-422b-94aa-d5b3e947dee3 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.272711 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-94c242be-7864-4180-9fe2-82b56702874f req-eb88da64-f169-422b-94aa-d5b3e947dee3 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.302054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-94c242be-7864-4180-9fe2-82b56702874f req-eb88da64-f169-422b-94aa-d5b3e947dee3 service nova] Creating event network-changed:3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae for instance b188c4dd-b4cc-4a02-9ea4-901009c68534 on hv-cinder-66710 Nov 16 19:02:51.310083 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-94c242be-7864-4180-9fe2-82b56702874f req-eb88da64-f169-422b-94aa-d5b3e947dee3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065477 Nov 16 19:02:51.310933 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 94/192] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:02:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:02:51.369285 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3ff321d5-a016-4526-ac6b-0afb0b6294e4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:51.378899 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3ff321d5-a016-4526-ac6b-0afb0b6294e4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1501 microversion: 2.1 time: 0.225950 Nov 16 19:02:51.379434 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 99/193] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:51 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1501 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:51.407969 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5eff29d9-8a16-4433-afe1-42d56b7f989a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:51.417865 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:51.418712 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5eff29d9-8a16-4433-afe1-42d56b7f989a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:51.426384 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:51.438260 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5eff29d9-8a16-4433-afe1-42d56b7f989a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.441584 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5eff29d9-8a16-4433-afe1-42d56b7f989a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.445995 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5eff29d9-8a16-4433-afe1-42d56b7f989a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.447644 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5eff29d9-8a16-4433-afe1-42d56b7f989a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.450772 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.451781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.452908 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.453427 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.715437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5eff29d9-8a16-4433-afe1-42d56b7f989a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:51.716519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:51.724686 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:51.725348 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5eff29d9-8a16-4433-afe1-42d56b7f989a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1515 microversion: 2.1 time: 0.325488 Nov 16 19:02:51.725992 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 95/194] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:51 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1515 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:51.737649 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4348565b-bfb4-4310-bc17-1ac65f0c57de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:51.737649 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4348565b-bfb4-4310-bc17-1ac65f0c57de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:51.739397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:51.741514 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9da5f773-9bae-4c90-97b5-62b5aa7aa784 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.331589 Nov 16 19:02:51.741667 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4348565b-bfb4-4310-bc17-1ac65f0c57de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.742021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4348565b-bfb4-4310-bc17-1ac65f0c57de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.743044 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4348565b-bfb4-4310-bc17-1ac65f0c57de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:51.743694 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4348565b-bfb4-4310-bc17-1ac65f0c57de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:51.753140 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 100/195] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:51 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:51.848876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4348565b-bfb4-4310-bc17-1ac65f0c57de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 28883 microversion: 2.1 time: 0.121573 Nov 16 19:02:51.849861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 96/196] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:51 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 28883 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:52.760660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:52.761195 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:52.767521 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:52.767965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:52.768731 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:52.769161 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:52.860543 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ad4fbbc3-438f-46ee-b321-05d906e396f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:52.861654 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ad4fbbc3-438f-46ee-b321-05d906e396f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:52.869875 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ad4fbbc3-438f-46ee-b321-05d906e396f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:52.870331 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ad4fbbc3-438f-46ee-b321-05d906e396f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:52.871119 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ad4fbbc3-438f-46ee-b321-05d906e396f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:52.871702 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ad4fbbc3-438f-46ee-b321-05d906e396f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:52.906925 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:52.915232 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:52.916743 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:52.917883 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dc41a826-fb81-4dff-b930-bf59ba5b2b3e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.161676 Nov 16 19:02:52.918447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 101/197] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:52 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:53.073355 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ad4fbbc3-438f-46ee-b321-05d906e396f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 32037 microversion: 2.1 time: 0.216541 Nov 16 19:02:53.074027 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 97/198] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:52 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 32037 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:02:53.228141 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-debc64ef-6eaf-4136-8672-cffbbfc00617 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:53.229407 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-debc64ef-6eaf-4136-8672-cffbbfc00617 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:53.238570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-debc64ef-6eaf-4136-8672-cffbbfc00617 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:53.240307 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-debc64ef-6eaf-4136-8672-cffbbfc00617 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:53.242482 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-debc64ef-6eaf-4136-8672-cffbbfc00617 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:53.243377 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-debc64ef-6eaf-4136-8672-cffbbfc00617 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:53.285648 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-debc64ef-6eaf-4136-8672-cffbbfc00617 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lazy-loading 'flavor' on Instance uuid c22ea69e-6ab3-4ba5-b12b-f940430d6649 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:02:53.408766 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-debc64ef-6eaf-4136-8672-cffbbfc00617 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/action" status: 200 len: 32 microversion: 2.1 time: 0.186762 Nov 16 19:02:53.409389 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 102/199] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:53 2021] POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:02:53.420101 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-90420984-f386-4992-b174-05d099f6d70c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:53.420759 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-90420984-f386-4992-b174-05d099f6d70c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:53.429849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-90420984-f386-4992-b174-05d099f6d70c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:53.430338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-90420984-f386-4992-b174-05d099f6d70c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:53.431141 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-90420984-f386-4992-b174-05d099f6d70c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:53.431574 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-90420984-f386-4992-b174-05d099f6d70c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:53.662820 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-90420984-f386-4992-b174-05d099f6d70c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:53.673512 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-90420984-f386-4992-b174-05d099f6d70c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.257935 Nov 16 19:02:53.674374 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 98/200] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:53 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:53.940832 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:53.941564 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:53.948984 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:53.949454 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:53.950368 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:53.951087 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:54.086282 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-747e7392-ab4d-4b63-a92f-2bdb58dfcff7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:54.087218 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-747e7392-ab4d-4b63-a92f-2bdb58dfcff7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:54.099200 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-747e7392-ab4d-4b63-a92f-2bdb58dfcff7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:54.099666 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-747e7392-ab4d-4b63-a92f-2bdb58dfcff7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:54.100524 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-747e7392-ab4d-4b63-a92f-2bdb58dfcff7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:54.100958 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-747e7392-ab4d-4b63-a92f-2bdb58dfcff7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:54.122537 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:54.132495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:54.134431 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:54.135770 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2b75bc73-24cf-4cfb-8431-05ecbef871f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.199410 Nov 16 19:02:54.146596 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 103/201] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:53 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:54.206988 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-747e7392-ab4d-4b63-a92f-2bdb58dfcff7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 33540 microversion: 2.1 time: 0.125250 Nov 16 19:02:54.207635 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 99/202] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:54 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 33540 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:02:54.691773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-75158ef8-a558-4d95-a1b7-530e4d5c3f65 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:54.692376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-75158ef8-a558-4d95-a1b7-530e4d5c3f65 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:54.698036 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75158ef8-a558-4d95-a1b7-530e4d5c3f65 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:54.698457 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75158ef8-a558-4d95-a1b7-530e4d5c3f65 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:54.699223 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75158ef8-a558-4d95-a1b7-530e4d5c3f65 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:54.699719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75158ef8-a558-4d95-a1b7-530e4d5c3f65 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:54.835366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-75158ef8-a558-4d95-a1b7-530e4d5c3f65 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:54.842608 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-75158ef8-a558-4d95-a1b7-530e4d5c3f65 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.154449 Nov 16 19:02:54.843173 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 104/203] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:54 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:55.154655 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:55.155421 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:55.162347 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:55.162804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:55.163589 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:55.164024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:55.258269 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8f71b043-b2bd-4a78-904b-225ff48709b3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:55.259533 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8f71b043-b2bd-4a78-904b-225ff48709b3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:55.265902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f71b043-b2bd-4a78-904b-225ff48709b3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:55.266348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f71b043-b2bd-4a78-904b-225ff48709b3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:55.267129 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f71b043-b2bd-4a78-904b-225ff48709b3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:55.267570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f71b043-b2bd-4a78-904b-225ff48709b3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:55.307143 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:55.315291 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:55.316774 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:55.317910 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2ffea6db-6acc-4f0d-90eb-3ee9ee352090 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.167370 Nov 16 19:02:55.318461 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 100/204] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:55 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:55.861082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-89512941-f303-4748-bc8b-5d65af12adb7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:55.861677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-89512941-f303-4748-bc8b-5d65af12adb7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:55.868397 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89512941-f303-4748-bc8b-5d65af12adb7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:55.868842 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89512941-f303-4748-bc8b-5d65af12adb7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:55.869648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89512941-f303-4748-bc8b-5d65af12adb7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:55.870082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89512941-f303-4748-bc8b-5d65af12adb7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:56.017690 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-89512941-f303-4748-bc8b-5d65af12adb7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:56.025965 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-89512941-f303-4748-bc8b-5d65af12adb7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.168778 Nov 16 19:02:56.026544 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 101/205] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:55 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:56.337062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:56.337996 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:56.344066 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:56.344512 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:56.345294 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:56.345754 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:56.476804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:56.484691 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:56.486204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:56.487312 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0f7b5747-b832-4185-886b-5f3dae1957fd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.154541 Nov 16 19:02:56.487877 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 102/206] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:56 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:57.042968 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5b27bc51-89b7-4aaf-b39d-ebdf6d833623 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:57.043503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5b27bc51-89b7-4aaf-b39d-ebdf6d833623 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:57.049798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5b27bc51-89b7-4aaf-b39d-ebdf6d833623 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:57.050247 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5b27bc51-89b7-4aaf-b39d-ebdf6d833623 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:57.051351 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5b27bc51-89b7-4aaf-b39d-ebdf6d833623 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:57.051472 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5b27bc51-89b7-4aaf-b39d-ebdf6d833623 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:57.183626 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5b27bc51-89b7-4aaf-b39d-ebdf6d833623 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:57.190854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5b27bc51-89b7-4aaf-b39d-ebdf6d833623 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.151648 Nov 16 19:02:57.191420 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 103/207] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:57 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:02:57.504820 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:57.505483 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:57.511803 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:57.512358 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:57.513048 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:57.513468 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:57.646719 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:57.654545 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:57.656058 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:57.657160 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b5661ff9-a982-4164-b8ea-2820d157ec24 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.156078 Nov 16 19:02:57.657725 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 104/208] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:57 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:02:57.817203 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8f71b043-b2bd-4a78-904b-225ff48709b3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 36277 microversion: 2.1 time: 2.563111 Nov 16 19:02:57.821288 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 105/209] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:55 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 36277 bytes in 2565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:02:58.207679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-22cbda7d-9fca-474c-8522-27e926f9dcbd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:58.208338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-22cbda7d-9fca-474c-8522-27e926f9dcbd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:58.215815 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-22cbda7d-9fca-474c-8522-27e926f9dcbd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:58.216404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-22cbda7d-9fca-474c-8522-27e926f9dcbd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:58.217247 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-22cbda7d-9fca-474c-8522-27e926f9dcbd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:58.217902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-22cbda7d-9fca-474c-8522-27e926f9dcbd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:58.352743 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-22cbda7d-9fca-474c-8522-27e926f9dcbd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:58.360015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-22cbda7d-9fca-474c-8522-27e926f9dcbd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.156236 Nov 16 19:02:58.360570 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 105/210] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:58 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:58.675758 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:58.676445 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:58.683244 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:58.683688 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:58.684452 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:58.684879 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:58.820935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:58.828145 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3e8d9ef3-bb8a-4da1-b70f-248d677984e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:58.829090 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3e8d9ef3-bb8a-4da1-b70f-248d677984e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:58.829692 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:58.831194 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:58.832304 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8c11b85a-8399-4b7e-9ec7-e3394f58fd57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.160630 Nov 16 19:02:58.832847 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 106/211] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:58 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:02:58.835523 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3e8d9ef3-bb8a-4da1-b70f-248d677984e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:58.835966 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3e8d9ef3-bb8a-4da1-b70f-248d677984e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:58.836743 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3e8d9ef3-bb8a-4da1-b70f-248d677984e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:58.837173 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3e8d9ef3-bb8a-4da1-b70f-248d677984e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:58.931559 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3e8d9ef3-bb8a-4da1-b70f-248d677984e5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 36701 microversion: 2.1 time: 0.106801 Nov 16 19:02:58.932196 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 106/212] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:58 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 36701 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:02:59.378318 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-356ce269-db18-48b4-b84e-1f3c5ceff0a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:59.378895 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-356ce269-db18-48b4-b84e-1f3c5ceff0a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:59.386058 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-356ce269-db18-48b4-b84e-1f3c5ceff0a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:59.386507 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-356ce269-db18-48b4-b84e-1f3c5ceff0a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:59.387278 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-356ce269-db18-48b4-b84e-1f3c5ceff0a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:59.387713 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-356ce269-db18-48b4-b84e-1f3c5ceff0a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:59.523893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-356ce269-db18-48b4-b84e-1f3c5ceff0a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:02:59.531142 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-356ce269-db18-48b4-b84e-1f3c5ceff0a7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.156476 Nov 16 19:02:59.531700 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 107/213] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:02:59 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:02:59.851161 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:02:59.851850 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:59.858640 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:59.859089 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:59.859875 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:59.860308 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:59.948824 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e68fdfc7-4be0-4911-9897-e6870bda96d7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:02:59.950049 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e68fdfc7-4be0-4911-9897-e6870bda96d7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:02:59.959394 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e68fdfc7-4be0-4911-9897-e6870bda96d7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:59.960296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e68fdfc7-4be0-4911-9897-e6870bda96d7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:02:59.962035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e68fdfc7-4be0-4911-9897-e6870bda96d7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:02:59.964098 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e68fdfc7-4be0-4911-9897-e6870bda96d7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:00.030463 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:00.052860 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:00.057148 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:00.059473 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3dfc7fd9-45ab-4ab2-a80e-d5f2c11a5a8b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.212020 Nov 16 19:03:00.061599 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 107/214] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:02:59 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:03:00.092851 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e68fdfc7-4be0-4911-9897-e6870bda96d7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 37077 microversion: 2.1 time: 0.150626 Nov 16 19:03:00.094075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 108/215] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:02:59 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 37077 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:03:00.322399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-dfbd8d10-c02e-4e49-8ab0-7aa3081cc045 req-4aaab58c-2666-4454-a037-96289caa9632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b188c4dd-b4cc-4a02-9ea4-901009c68534", "name": "network-vif-plugged", "status": "completed", "tag": "3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:00.324281 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:03:00.324281 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:03:00.331681 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-dfbd8d10-c02e-4e49-8ab0-7aa3081cc045 req-4aaab58c-2666-4454-a037-96289caa9632 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:00.332179 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-dfbd8d10-c02e-4e49-8ab0-7aa3081cc045 req-4aaab58c-2666-4454-a037-96289caa9632 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:00.343508 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-dfbd8d10-c02e-4e49-8ab0-7aa3081cc045 req-4aaab58c-2666-4454-a037-96289caa9632 service nova] Creating event network-vif-plugged:3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae for instance b188c4dd-b4cc-4a02-9ea4-901009c68534 on hv-cinder-66710 Nov 16 19:03:00.348337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-dfbd8d10-c02e-4e49-8ab0-7aa3081cc045 req-4aaab58c-2666-4454-a037-96289caa9632 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032335 Nov 16 19:03:00.348989 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 108/216] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:03:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:00.548628 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3c1561ce-8f12-4f48-866b-fde01a791a94 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:00.549485 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3c1561ce-8f12-4f48-866b-fde01a791a94 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:00.556875 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c1561ce-8f12-4f48-866b-fde01a791a94 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:00.557322 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c1561ce-8f12-4f48-866b-fde01a791a94 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:00.558133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c1561ce-8f12-4f48-866b-fde01a791a94 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:00.558562 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c1561ce-8f12-4f48-866b-fde01a791a94 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:00.702721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3c1561ce-8f12-4f48-866b-fde01a791a94 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:00.710721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3c1561ce-8f12-4f48-866b-fde01a791a94 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.166233 Nov 16 19:03:00.711289 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 109/217] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:00 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:01.079935 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:01.080615 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:01.087227 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:01.087670 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:01.088436 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:01.088860 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:01.105381 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-87ef15a7-626a-49ef-8cb9-a117d3562329 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:01.106607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-87ef15a7-626a-49ef-8cb9-a117d3562329 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:01.112790 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87ef15a7-626a-49ef-8cb9-a117d3562329 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:01.113351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87ef15a7-626a-49ef-8cb9-a117d3562329 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:01.114371 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87ef15a7-626a-49ef-8cb9-a117d3562329 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:01.114904 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87ef15a7-626a-49ef-8cb9-a117d3562329 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:01.210421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-87ef15a7-626a-49ef-8cb9-a117d3562329 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 37525 microversion: 2.1 time: 0.108026 Nov 16 19:03:01.211162 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 110/218] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:01 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 37525 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:03:01.244484 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:01.252364 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:01.253903 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:01.255010 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f0c2423f-8914-4417-a499-3417ad6906bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1406 microversion: 2.20 time: 0.179859 Nov 16 19:03:01.255729 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 109/219] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:03:01 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:03:01.728897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9809a4ed-db6b-4179-81b8-b198eadb09f0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:01.729750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9809a4ed-db6b-4179-81b8-b198eadb09f0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:01.736862 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9809a4ed-db6b-4179-81b8-b198eadb09f0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:01.737311 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9809a4ed-db6b-4179-81b8-b198eadb09f0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:01.738128 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9809a4ed-db6b-4179-81b8-b198eadb09f0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:01.738557 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9809a4ed-db6b-4179-81b8-b198eadb09f0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:01.873577 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9809a4ed-db6b-4179-81b8-b198eadb09f0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:01.881369 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9809a4ed-db6b-4179-81b8-b198eadb09f0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.156983 Nov 16 19:03:01.881968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 111/220] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:01 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:02.222899 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-de819ed1-ce49-401a-ab63-ae47ba29481f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:02.224405 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-de819ed1-ce49-401a-ab63-ae47ba29481f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:02.231577 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-de819ed1-ce49-401a-ab63-ae47ba29481f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:02.232091 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-de819ed1-ce49-401a-ab63-ae47ba29481f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:02.232882 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-de819ed1-ce49-401a-ab63-ae47ba29481f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:02.233319 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-de819ed1-ce49-401a-ab63-ae47ba29481f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:02.274595 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:02.275132 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:02.282667 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:02.283148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:02.283951 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:02.285117 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:02.335302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-de819ed1-ce49-401a-ab63-ae47ba29481f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 37814 microversion: 2.1 time: 0.115382 Nov 16 19:03:02.336168 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 110/221] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:02 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 37814 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:03:02.424139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:02.431877 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:02.433387 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:02.434553 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-49f07961-00b8-4654-9f56-09eb9b58e743 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1596 microversion: 2.20 time: 0.164610 Nov 16 19:03:02.435115 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 112/222] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:03:02 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1596 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:03:02.452825 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-caeaadf4-8a8c-4161-9fae-e8fa5d0ac51b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:02.453391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-caeaadf4-8a8c-4161-9fae-e8fa5d0ac51b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:02.460812 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-caeaadf4-8a8c-4161-9fae-e8fa5d0ac51b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:02.461319 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-caeaadf4-8a8c-4161-9fae-e8fa5d0ac51b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:02.462075 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-caeaadf4-8a8c-4161-9fae-e8fa5d0ac51b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:02.462501 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-caeaadf4-8a8c-4161-9fae-e8fa5d0ac51b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:02.543775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-caeaadf4-8a8c-4161-9fae-e8fa5d0ac51b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094934 Nov 16 19:03:02.544366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 111/223] 10.222.0.46 () {60 vars in 1315 bytes} [Tue Nov 16 19:03:02 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:03:02.899575 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8234016c-c930-481a-a18c-706e70773a14 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:02.900666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8234016c-c930-481a-a18c-706e70773a14 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:02.907664 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8234016c-c930-481a-a18c-706e70773a14 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:02.908393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8234016c-c930-481a-a18c-706e70773a14 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:02.909388 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8234016c-c930-481a-a18c-706e70773a14 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:02.910010 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8234016c-c930-481a-a18c-706e70773a14 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:03.168113 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8234016c-c930-481a-a18c-706e70773a14 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:03.176653 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8234016c-c930-481a-a18c-706e70773a14 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.280717 Nov 16 19:03:03.177237 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 113/224] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:02 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:03.352618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1253dc34-d213-4879-9e33-f38cd669312a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:03.353560 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1253dc34-d213-4879-9e33-f38cd669312a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:03.360069 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1253dc34-d213-4879-9e33-f38cd669312a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:03.360449 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1253dc34-d213-4879-9e33-f38cd669312a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:03.362136 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1253dc34-d213-4879-9e33-f38cd669312a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:03.362716 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1253dc34-d213-4879-9e33-f38cd669312a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:03.900924 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1a8e98fb-45fe-447a-a9b0-d18d3ab90717 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:03.902026 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1a8e98fb-45fe-447a-a9b0-d18d3ab90717 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:03.915447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a8e98fb-45fe-447a-a9b0-d18d3ab90717 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:03.918420 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a8e98fb-45fe-447a-a9b0-d18d3ab90717 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:03.919337 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a8e98fb-45fe-447a-a9b0-d18d3ab90717 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:03.920936 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a8e98fb-45fe-447a-a9b0-d18d3ab90717 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:06.182388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1253dc34-d213-4879-9e33-f38cd669312a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 38069 microversion: 2.1 time: 2.837312 Nov 16 19:03:06.183061 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 112/225] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:03 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 38069 bytes in 2839 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:03:06.188132 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-cb579f31-3d6c-4c0b-9653-89b8fc82e98e req-80e68cb1-96b1-4ab0-af5a-fe79a6dc4b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b188c4dd-b4cc-4a02-9ea4-901009c68534", "tag": "3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:06.189631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:03:06.189631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:03:06.199639 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-cb579f31-3d6c-4c0b-9653-89b8fc82e98e req-80e68cb1-96b1-4ab0-af5a-fe79a6dc4b6e service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:06.199639 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-cb579f31-3d6c-4c0b-9653-89b8fc82e98e req-80e68cb1-96b1-4ab0-af5a-fe79a6dc4b6e service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:06.212216 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-cb579f31-3d6c-4c0b-9653-89b8fc82e98e req-80e68cb1-96b1-4ab0-af5a-fe79a6dc4b6e service nova] Creating event network-changed:3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae for instance b188c4dd-b4cc-4a02-9ea4-901009c68534 on hv-cinder-66710 Nov 16 19:03:06.214321 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1a8e98fb-45fe-447a-a9b0-d18d3ab90717 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 2.317775 Nov 16 19:03:06.217191 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-cb579f31-3d6c-4c0b-9653-89b8fc82e98e req-80e68cb1-96b1-4ab0-af5a-fe79a6dc4b6e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032941 Nov 16 19:03:06.217800 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 113/227] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:03:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:06.217916 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 114/227] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:03 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:06.223108 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9b0e00ba-84ef-4a15-a5b2-d58249bed71c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:06.223801 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9b0e00ba-84ef-4a15-a5b2-d58249bed71c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:06.230037 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b0e00ba-84ef-4a15-a5b2-d58249bed71c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:06.230489 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b0e00ba-84ef-4a15-a5b2-d58249bed71c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:06.231759 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b0e00ba-84ef-4a15-a5b2-d58249bed71c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:06.232196 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b0e00ba-84ef-4a15-a5b2-d58249bed71c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:06.376300 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9b0e00ba-84ef-4a15-a5b2-d58249bed71c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:06.387272 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9b0e00ba-84ef-4a15-a5b2-d58249bed71c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.167883 Nov 16 19:03:06.387837 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 115/228] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:06 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:07.195718 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8ff11ddc-59a8-4848-a5ac-b2533e7bbf7e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:07.196701 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8ff11ddc-59a8-4848-a5ac-b2533e7bbf7e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:07.202709 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ff11ddc-59a8-4848-a5ac-b2533e7bbf7e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:07.203147 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ff11ddc-59a8-4848-a5ac-b2533e7bbf7e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:07.203903 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ff11ddc-59a8-4848-a5ac-b2533e7bbf7e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:07.204328 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ff11ddc-59a8-4848-a5ac-b2533e7bbf7e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:07.224651 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-67d38c4c-8652-4f73-91ff-9d68afd4e29c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:07.225648 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-67d38c4c-8652-4f73-91ff-9d68afd4e29c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:07.233116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67d38c4c-8652-4f73-91ff-9d68afd4e29c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:07.233572 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67d38c4c-8652-4f73-91ff-9d68afd4e29c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:07.234362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67d38c4c-8652-4f73-91ff-9d68afd4e29c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:07.234789 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67d38c4c-8652-4f73-91ff-9d68afd4e29c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:09.915412 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-67d38c4c-8652-4f73-91ff-9d68afd4e29c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 2.694186 Nov 16 19:03:09.916334 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 116/229] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:07 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:09.923992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8ff4e1b0-c6fc-4aa3-a852-95b4a5bc7147 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:09.924869 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8ff4e1b0-c6fc-4aa3-a852-95b4a5bc7147 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:09.934867 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8ff4e1b0-c6fc-4aa3-a852-95b4a5bc7147 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:09.935324 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8ff4e1b0-c6fc-4aa3-a852-95b4a5bc7147 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:09.936120 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8ff4e1b0-c6fc-4aa3-a852-95b4a5bc7147 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:09.936556 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8ff4e1b0-c6fc-4aa3-a852-95b4a5bc7147 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:09.936681 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8ff11ddc-59a8-4848-a5ac-b2533e7bbf7e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 38139 microversion: 2.1 time: 2.745803 Nov 16 19:03:09.937630 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 114/230] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:07 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 38139 bytes in 2748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:03:10.089203 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8ff4e1b0-c6fc-4aa3-a852-95b4a5bc7147 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:10.096772 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8ff4e1b0-c6fc-4aa3-a852-95b4a5bc7147 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.178999 Nov 16 19:03:10.097349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 117/231] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:09 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:10.928616 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-eefebd0a-6a8a-4a0d-a102-ede21659187d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:10.932696 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-eefebd0a-6a8a-4a0d-a102-ede21659187d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:10.941811 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-eefebd0a-6a8a-4a0d-a102-ede21659187d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:10.942482 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-eefebd0a-6a8a-4a0d-a102-ede21659187d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:10.943090 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-eefebd0a-6a8a-4a0d-a102-ede21659187d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:10.944112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-eefebd0a-6a8a-4a0d-a102-ede21659187d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:10.948646 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ee6ec0e3-3f3c-412d-858f-b18c0f6bd119 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:10.949586 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ee6ec0e3-3f3c-412d-858f-b18c0f6bd119 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:10.955705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee6ec0e3-3f3c-412d-858f-b18c0f6bd119 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:10.956144 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee6ec0e3-3f3c-412d-858f-b18c0f6bd119 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:10.956938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee6ec0e3-3f3c-412d-858f-b18c0f6bd119 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:10.957369 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee6ec0e3-3f3c-412d-858f-b18c0f6bd119 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:11.025239 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-eefebd0a-6a8a-4a0d-a102-ede21659187d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 0.101813 Nov 16 19:03:11.025811 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 115/232] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:10 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:11.071972 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ee6ec0e3-3f3c-412d-858f-b18c0f6bd119 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 38141 microversion: 2.1 time: 0.126544 Nov 16 19:03:11.072692 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 118/233] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:10 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 38141 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:03:11.113522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b2bef6ca-f064-4376-91cf-510bd6be890c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:11.114328 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b2bef6ca-f064-4376-91cf-510bd6be890c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:11.122329 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b2bef6ca-f064-4376-91cf-510bd6be890c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:11.122780 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b2bef6ca-f064-4376-91cf-510bd6be890c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:11.123568 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b2bef6ca-f064-4376-91cf-510bd6be890c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:11.123999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b2bef6ca-f064-4376-91cf-510bd6be890c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:11.284018 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b2bef6ca-f064-4376-91cf-510bd6be890c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:11.293884 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b2bef6ca-f064-4376-91cf-510bd6be890c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.184114 Nov 16 19:03:11.305289 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 116/234] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:11 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:12.039117 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eb5a98b3-409e-4a35-bb02-a8e8f1b1fd29 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:12.040153 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eb5a98b3-409e-4a35-bb02-a8e8f1b1fd29 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:12.047552 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb5a98b3-409e-4a35-bb02-a8e8f1b1fd29 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:12.048258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb5a98b3-409e-4a35-bb02-a8e8f1b1fd29 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:12.049052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb5a98b3-409e-4a35-bb02-a8e8f1b1fd29 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:12.049830 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb5a98b3-409e-4a35-bb02-a8e8f1b1fd29 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:12.090008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ef3640c7-f856-436b-a3b7-2062300f2755 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:12.091123 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ef3640c7-f856-436b-a3b7-2062300f2755 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:12.097898 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ef3640c7-f856-436b-a3b7-2062300f2755 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:12.098403 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ef3640c7-f856-436b-a3b7-2062300f2755 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:12.099208 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ef3640c7-f856-436b-a3b7-2062300f2755 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:12.099677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ef3640c7-f856-436b-a3b7-2062300f2755 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:12.120155 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eb5a98b3-409e-4a35-bb02-a8e8f1b1fd29 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 0.088303 Nov 16 19:03:12.121145 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 119/235] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:12 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:12.189118 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ef3640c7-f856-436b-a3b7-2062300f2755 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 200 len: 38270 microversion: 2.1 time: 0.102914 Nov 16 19:03:12.189794 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 117/236] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:12 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 38270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:03:12.200433 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b96fefd0-2442-4f6c-8105-3a051932c867 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:12.201088 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b96fefd0-2442-4f6c-8105-3a051932c867 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:12.208515 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b96fefd0-2442-4f6c-8105-3a051932c867 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:12.209564 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b96fefd0-2442-4f6c-8105-3a051932c867 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:12.210363 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b96fefd0-2442-4f6c-8105-3a051932c867 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:12.210798 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b96fefd0-2442-4f6c-8105-3a051932c867 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:12.236566 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b96fefd0-2442-4f6c-8105-3a051932c867 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/ips" status: 200 len: 142 microversion: 2.1 time: 0.040201 Nov 16 19:03:12.237198 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 120/237] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 19:03:12 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/ips => generated 142 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:12.311717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-255b3f3e-0fc1-46d2-8018-1a25e27a6592 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:12.312469 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-255b3f3e-0fc1-46d2-8018-1a25e27a6592 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:12.318902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-255b3f3e-0fc1-46d2-8018-1a25e27a6592 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:12.319391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-255b3f3e-0fc1-46d2-8018-1a25e27a6592 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:12.320223 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-255b3f3e-0fc1-46d2-8018-1a25e27a6592 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:12.320746 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-255b3f3e-0fc1-46d2-8018-1a25e27a6592 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:12.473507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-255b3f3e-0fc1-46d2-8018-1a25e27a6592 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:12.482580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-255b3f3e-0fc1-46d2-8018-1a25e27a6592 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.174788 Nov 16 19:03:12.483146 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 118/238] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:12 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:13.138826 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e576c7b6-c9f2-425c-b9a8-74488be73c07 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:13.139753 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e576c7b6-c9f2-425c-b9a8-74488be73c07 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:13.156562 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e576c7b6-c9f2-425c-b9a8-74488be73c07 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:13.157032 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e576c7b6-c9f2-425c-b9a8-74488be73c07 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:13.157968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e576c7b6-c9f2-425c-b9a8-74488be73c07 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:13.158647 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e576c7b6-c9f2-425c-b9a8-74488be73c07 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:13.242641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e576c7b6-c9f2-425c-b9a8-74488be73c07 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 0.113143 Nov 16 19:03:13.245349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 121/239] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:13 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:13.500731 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f3926b43-e81c-479a-a07a-678dc0359074 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:13.501363 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f3926b43-e81c-479a-a07a-678dc0359074 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:13.516026 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3926b43-e81c-479a-a07a-678dc0359074 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:13.516470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3926b43-e81c-479a-a07a-678dc0359074 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:13.517251 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3926b43-e81c-479a-a07a-678dc0359074 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:13.517717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3926b43-e81c-479a-a07a-678dc0359074 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:13.679210 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f3926b43-e81c-479a-a07a-678dc0359074 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:13.689664 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f3926b43-e81c-479a-a07a-678dc0359074 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.193220 Nov 16 19:03:13.690347 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 119/240] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:13 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:14.254575 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-934d7d27-9d6b-4fa7-9207-302380b43366 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:14.255619 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-934d7d27-9d6b-4fa7-9207-302380b43366 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:14.263642 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-934d7d27-9d6b-4fa7-9207-302380b43366 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:14.264102 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-934d7d27-9d6b-4fa7-9207-302380b43366 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:14.264968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-934d7d27-9d6b-4fa7-9207-302380b43366 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:14.265325 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-934d7d27-9d6b-4fa7-9207-302380b43366 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:14.331631 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-934d7d27-9d6b-4fa7-9207-302380b43366 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 0.080865 Nov 16 19:03:14.332284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 122/241] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:14 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:14.707168 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e7ebabdb-cb08-413a-83cd-48f82a8fc323 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:14.707767 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e7ebabdb-cb08-413a-83cd-48f82a8fc323 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:14.713915 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e7ebabdb-cb08-413a-83cd-48f82a8fc323 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:14.714358 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e7ebabdb-cb08-413a-83cd-48f82a8fc323 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:14.715128 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e7ebabdb-cb08-413a-83cd-48f82a8fc323 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:14.715557 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e7ebabdb-cb08-413a-83cd-48f82a8fc323 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:14.852189 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e7ebabdb-cb08-413a-83cd-48f82a8fc323 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:14.859469 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e7ebabdb-cb08-413a-83cd-48f82a8fc323 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.156114 Nov 16 19:03:14.860045 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 120/242] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:14 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:14.895610 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-05397261-12f4-4aa8-8f26-32867d63020c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ca19f6c-03ab-458e-9723-5b51d5a5d826"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:14.896819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-05397261-12f4-4aa8-8f26-32867d63020c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:14.903607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05397261-12f4-4aa8-8f26-32867d63020c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:14.904050 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05397261-12f4-4aa8-8f26-32867d63020c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:14.904820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05397261-12f4-4aa8-8f26-32867d63020c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:14.905252 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05397261-12f4-4aa8-8f26-32867d63020c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:15.149236 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-05397261-12f4-4aa8-8f26-32867d63020c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257497 Nov 16 19:03:15.150062 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 123/243] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:03:14 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:15.346200 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-361813c8-50c9-4392-840b-4128506569af tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:15.346200 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-361813c8-50c9-4392-840b-4128506569af tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:15.352449 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-361813c8-50c9-4392-840b-4128506569af tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:15.353234 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-361813c8-50c9-4392-840b-4128506569af tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:15.354891 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-361813c8-50c9-4392-840b-4128506569af tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:15.356395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-361813c8-50c9-4392-840b-4128506569af tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:15.878064 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-be14a097-a287-46cc-b8b7-95f6374aadb9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:15.878982 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-be14a097-a287-46cc-b8b7-95f6374aadb9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:15.886517 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-be14a097-a287-46cc-b8b7-95f6374aadb9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:15.886966 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-be14a097-a287-46cc-b8b7-95f6374aadb9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:15.887746 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-be14a097-a287-46cc-b8b7-95f6374aadb9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:15.888186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-be14a097-a287-46cc-b8b7-95f6374aadb9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:16.068509 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-be14a097-a287-46cc-b8b7-95f6374aadb9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:16.077784 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-be14a097-a287-46cc-b8b7-95f6374aadb9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.203698 Nov 16 19:03:16.078363 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 124/244] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:15 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:17.095111 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-75294b11-5ad2-416b-a175-0952c9358a77 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:17.095828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-75294b11-5ad2-416b-a175-0952c9358a77 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:17.102534 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75294b11-5ad2-416b-a175-0952c9358a77 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:17.102979 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75294b11-5ad2-416b-a175-0952c9358a77 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:17.103764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75294b11-5ad2-416b-a175-0952c9358a77 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:17.104197 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75294b11-5ad2-416b-a175-0952c9358a77 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:17.235756 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-75294b11-5ad2-416b-a175-0952c9358a77 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:17.243676 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-75294b11-5ad2-416b-a175-0952c9358a77 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.152148 Nov 16 19:03:17.244393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 125/245] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:17 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:17.778257 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-361813c8-50c9-4392-840b-4128506569af tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 2.439277 Nov 16 19:03:17.781445 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 121/246] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:15 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:18.260916 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2f19de05-1202-41fa-8699-6b7058ce7e6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:18.261573 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2f19de05-1202-41fa-8699-6b7058ce7e6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:18.267333 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f19de05-1202-41fa-8699-6b7058ce7e6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:18.267867 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f19de05-1202-41fa-8699-6b7058ce7e6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:18.268639 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f19de05-1202-41fa-8699-6b7058ce7e6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:18.269072 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f19de05-1202-41fa-8699-6b7058ce7e6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:18.411407 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2f19de05-1202-41fa-8699-6b7058ce7e6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:18.419061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2f19de05-1202-41fa-8699-6b7058ce7e6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.162574 Nov 16 19:03:18.419745 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 126/247] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:18 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:18.790301 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5abdd681-61e2-4c87-89b0-c7b9895857f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:18.791298 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5abdd681-61e2-4c87-89b0-c7b9895857f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:18.798228 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5abdd681-61e2-4c87-89b0-c7b9895857f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:18.798668 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5abdd681-61e2-4c87-89b0-c7b9895857f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:18.799441 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5abdd681-61e2-4c87-89b0-c7b9895857f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:18.799869 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5abdd681-61e2-4c87-89b0-c7b9895857f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:18.879680 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5abdd681-61e2-4c87-89b0-c7b9895857f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 0.094002 Nov 16 19:03:18.880470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 122/248] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:18 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:19.437441 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a100d649-3e57-494e-93c6-a4157105415f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:19.438076 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a100d649-3e57-494e-93c6-a4157105415f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:19.444464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a100d649-3e57-494e-93c6-a4157105415f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:19.444916 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a100d649-3e57-494e-93c6-a4157105415f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:19.445719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a100d649-3e57-494e-93c6-a4157105415f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:19.446179 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a100d649-3e57-494e-93c6-a4157105415f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:19.577140 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a100d649-3e57-494e-93c6-a4157105415f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:19.584956 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a100d649-3e57-494e-93c6-a4157105415f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.151194 Nov 16 19:03:19.585511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 127/249] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:19 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:19.891059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-72e0c8b8-76d7-4b44-a9dc-08a91bb6b506 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:19.892071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-72e0c8b8-76d7-4b44-a9dc-08a91bb6b506 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:19.899336 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-72e0c8b8-76d7-4b44-a9dc-08a91bb6b506 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:19.899781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-72e0c8b8-76d7-4b44-a9dc-08a91bb6b506 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:19.900558 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-72e0c8b8-76d7-4b44-a9dc-08a91bb6b506 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:19.900988 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-72e0c8b8-76d7-4b44-a9dc-08a91bb6b506 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:19.962965 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-72e0c8b8-76d7-4b44-a9dc-08a91bb6b506 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 14 microversion: 2.20 time: 0.075560 Nov 16 19:03:19.963665 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 123/250] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:19 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:20.605850 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6e988c9d-96a2-48c6-bd95-40e7ad7b9cf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:20.606444 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6e988c9d-96a2-48c6-bd95-40e7ad7b9cf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:20.613240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e988c9d-96a2-48c6-bd95-40e7ad7b9cf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.613785 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e988c9d-96a2-48c6-bd95-40e7ad7b9cf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.614575 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e988c9d-96a2-48c6-bd95-40e7ad7b9cf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.615743 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e988c9d-96a2-48c6-bd95-40e7ad7b9cf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.746634 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6e988c9d-96a2-48c6-bd95-40e7ad7b9cf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:20.753863 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6e988c9d-96a2-48c6-bd95-40e7ad7b9cf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1501 microversion: 2.1 time: 0.151626 Nov 16 19:03:20.754421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 128/251] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:20 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:20.770849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d8463bb-2162-4ddd-92ec-07de7a7abac1"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:20.771982 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:20.779317 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.779756 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.780689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.781118 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.805788 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] HTTP exception thrown: Cannot 'attach_volume' instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 while it is in vm_state rescued Nov 16 19:03:20.806369 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Returning 409 to user: Cannot 'attach_volume' instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 while it is in vm_state rescued {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:03:20.807214 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8cd0688f-05cd-4963-b025-743400350366 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040499 Nov 16 19:03:20.807741 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 124/252] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:03:20 2021] POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 16 19:03:20.816292 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6f6ec4e3-05a0-429e-bd4d-67dc868496ad tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:20.816879 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6f6ec4e3-05a0-429e-bd4d-67dc868496ad tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:20.822630 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f6ec4e3-05a0-429e-bd4d-67dc868496ad tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.823073 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f6ec4e3-05a0-429e-bd4d-67dc868496ad tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.823831 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f6ec4e3-05a0-429e-bd4d-67dc868496ad tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.824283 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f6ec4e3-05a0-429e-bd4d-67dc868496ad tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.894041 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6f6ec4e3-05a0-429e-bd4d-67dc868496ad tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/action" status: 202 len: 0 microversion: 2.1 time: 0.081229 Nov 16 19:03:20.898450 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 129/253] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:20 2021] POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:20.904083 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0580e2dd-e9d9-438e-a031-218ad1be840e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:20.904694 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0580e2dd-e9d9-438e-a031-218ad1be840e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:20.911144 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0580e2dd-e9d9-438e-a031-218ad1be840e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.911575 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0580e2dd-e9d9-438e-a031-218ad1be840e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.913404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0580e2dd-e9d9-438e-a031-218ad1be840e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.914124 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0580e2dd-e9d9-438e-a031-218ad1be840e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.973535 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ddb1e08d-ff66-4c19-9ffa-83593726d492 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:20.975184 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ddb1e08d-ff66-4c19-9ffa-83593726d492 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:20.988592 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ddb1e08d-ff66-4c19-9ffa-83593726d492 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.989040 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ddb1e08d-ff66-4c19-9ffa-83593726d492 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:20.990075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ddb1e08d-ff66-4c19-9ffa-83593726d492 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:20.990686 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ddb1e08d-ff66-4c19-9ffa-83593726d492 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:21.081182 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ddb1e08d-ff66-4c19-9ffa-83593726d492 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 7493 microversion: 2.20 time: 0.111417 Nov 16 19:03:21.085275 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 130/254] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:20 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 7493 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:03:21.159123 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0580e2dd-e9d9-438e-a031-218ad1be840e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:21.166494 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0580e2dd-e9d9-438e-a031-218ad1be840e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1509 microversion: 2.1 time: 0.267092 Nov 16 19:03:21.167059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 125/255] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:20 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:22.093385 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dfb514ff-f50d-4057-9908-e4347c214f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:22.094415 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dfb514ff-f50d-4057-9908-e4347c214f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:22.101617 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfb514ff-f50d-4057-9908-e4347c214f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:22.102053 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfb514ff-f50d-4057-9908-e4347c214f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:22.102840 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfb514ff-f50d-4057-9908-e4347c214f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:22.103275 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfb514ff-f50d-4057-9908-e4347c214f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:22.190921 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ae620182-300d-40e3-a72e-fac45c3e3dde tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:22.191539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ae620182-300d-40e3-a72e-fac45c3e3dde tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:22.199938 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ae620182-300d-40e3-a72e-fac45c3e3dde tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:22.200952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ae620182-300d-40e3-a72e-fac45c3e3dde tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:22.201974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ae620182-300d-40e3-a72e-fac45c3e3dde tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:22.202975 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ae620182-300d-40e3-a72e-fac45c3e3dde tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:22.324835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dfb514ff-f50d-4057-9908-e4347c214f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 15025 microversion: 2.20 time: 0.235192 Nov 16 19:03:22.325990 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 131/256] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:22 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 15025 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:22.388535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ae620182-300d-40e3-a72e-fac45c3e3dde tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:22.397944 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ae620182-300d-40e3-a72e-fac45c3e3dde tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1509 microversion: 2.1 time: 0.217412 Nov 16 19:03:22.398556 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 126/257] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:22 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:23.340345 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d0cf89e6-d8ff-489b-a79d-2d968d6cb267 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:23.341375 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d0cf89e6-d8ff-489b-a79d-2d968d6cb267 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:23.354469 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d0cf89e6-d8ff-489b-a79d-2d968d6cb267 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:23.354925 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d0cf89e6-d8ff-489b-a79d-2d968d6cb267 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:23.355718 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d0cf89e6-d8ff-489b-a79d-2d968d6cb267 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:23.356494 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d0cf89e6-d8ff-489b-a79d-2d968d6cb267 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:23.415603 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cdea246e-8049-4570-82a6-0f2eed3849a0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:23.416222 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cdea246e-8049-4570-82a6-0f2eed3849a0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:23.422776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cdea246e-8049-4570-82a6-0f2eed3849a0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:23.423261 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cdea246e-8049-4570-82a6-0f2eed3849a0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:23.424048 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cdea246e-8049-4570-82a6-0f2eed3849a0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:23.424485 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cdea246e-8049-4570-82a6-0f2eed3849a0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:23.448644 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d0cf89e6-d8ff-489b-a79d-2d968d6cb267 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 17861 microversion: 2.20 time: 0.115137 Nov 16 19:03:23.449389 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 132/258] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:23 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 17861 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:23.643225 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cdea246e-8049-4570-82a6-0f2eed3849a0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:23.652431 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cdea246e-8049-4570-82a6-0f2eed3849a0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1509 microversion: 2.1 time: 0.240908 Nov 16 19:03:23.653213 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 127/259] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:23 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:24.461576 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-92050d81-68db-485a-8cbe-d51946de9019 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:24.462441 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-92050d81-68db-485a-8cbe-d51946de9019 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:24.469334 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92050d81-68db-485a-8cbe-d51946de9019 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:24.469805 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92050d81-68db-485a-8cbe-d51946de9019 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:24.470716 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92050d81-68db-485a-8cbe-d51946de9019 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:24.470995 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92050d81-68db-485a-8cbe-d51946de9019 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:24.566606 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-92050d81-68db-485a-8cbe-d51946de9019 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 17960 microversion: 2.20 time: 0.109910 Nov 16 19:03:24.567348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 133/260] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:24 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 17960 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:24.670697 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-80be17fc-dcc1-437e-b8d6-5e7f1f62038f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:24.671382 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-80be17fc-dcc1-437e-b8d6-5e7f1f62038f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:24.678105 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-80be17fc-dcc1-437e-b8d6-5e7f1f62038f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:24.678731 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-80be17fc-dcc1-437e-b8d6-5e7f1f62038f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:24.681641 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-80be17fc-dcc1-437e-b8d6-5e7f1f62038f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:24.682668 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-80be17fc-dcc1-437e-b8d6-5e7f1f62038f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:24.893329 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-80be17fc-dcc1-437e-b8d6-5e7f1f62038f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:24.901250 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-80be17fc-dcc1-437e-b8d6-5e7f1f62038f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1515 microversion: 2.1 time: 0.234760 Nov 16 19:03:24.901860 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 128/261] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:24 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:25.582397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2b02b42b-572e-4b3a-82cb-e5de9c27c3bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:25.584058 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2b02b42b-572e-4b3a-82cb-e5de9c27c3bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:25.591935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b02b42b-572e-4b3a-82cb-e5de9c27c3bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:25.592391 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b02b42b-572e-4b3a-82cb-e5de9c27c3bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:25.593391 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b02b42b-572e-4b3a-82cb-e5de9c27c3bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:25.593857 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b02b42b-572e-4b3a-82cb-e5de9c27c3bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:25.683381 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2b02b42b-572e-4b3a-82cb-e5de9c27c3bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 20148 microversion: 2.20 time: 0.105257 Nov 16 19:03:25.684187 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 134/262] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:25 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 20148 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:26.694601 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-10f15e4f-328a-4a46-88ce-83a4c92e9c46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:26.695507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-10f15e4f-328a-4a46-88ce-83a4c92e9c46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:26.701798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-10f15e4f-328a-4a46-88ce-83a4c92e9c46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:26.702242 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-10f15e4f-328a-4a46-88ce-83a4c92e9c46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:26.703015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-10f15e4f-328a-4a46-88ce-83a4c92e9c46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:26.703442 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-10f15e4f-328a-4a46-88ce-83a4c92e9c46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:26.795724 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-10f15e4f-328a-4a46-88ce-83a4c92e9c46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 22211 microversion: 2.20 time: 0.104505 Nov 16 19:03:26.796715 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 129/263] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:26 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 22211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:27.808544 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5624aa71-5e17-4ea6-8540-8a35290d4814 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:27.809595 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5624aa71-5e17-4ea6-8540-8a35290d4814 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:27.816388 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5624aa71-5e17-4ea6-8540-8a35290d4814 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:27.816838 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5624aa71-5e17-4ea6-8540-8a35290d4814 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:27.817663 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5624aa71-5e17-4ea6-8540-8a35290d4814 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:27.818649 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5624aa71-5e17-4ea6-8540-8a35290d4814 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:27.898479 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5624aa71-5e17-4ea6-8540-8a35290d4814 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 23593 microversion: 2.20 time: 0.093878 Nov 16 19:03:27.899181 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 135/264] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:27 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 23593 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:28.912604 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6ca5af91-a3e3-47ec-8c8c-6154dbb94330 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:28.913834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6ca5af91-a3e3-47ec-8c8c-6154dbb94330 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:28.921323 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6ca5af91-a3e3-47ec-8c8c-6154dbb94330 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:28.921800 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6ca5af91-a3e3-47ec-8c8c-6154dbb94330 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:28.922592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6ca5af91-a3e3-47ec-8c8c-6154dbb94330 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:28.923024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6ca5af91-a3e3-47ec-8c8c-6154dbb94330 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:31.995863 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6ca5af91-a3e3-47ec-8c8c-6154dbb94330 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 26737 microversion: 2.20 time: 3.087913 Nov 16 19:03:31.997464 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 130/265] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:28 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 26737 bytes in 3090 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:32.614317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-87cb1dab-53c9-42d3-9620-1f2c393fd55a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:32.615871 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-87cb1dab-53c9-42d3-9620-1f2c393fd55a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:32.623749 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87cb1dab-53c9-42d3-9620-1f2c393fd55a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:32.624409 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87cb1dab-53c9-42d3-9620-1f2c393fd55a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:32.625303 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87cb1dab-53c9-42d3-9620-1f2c393fd55a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:32.625792 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87cb1dab-53c9-42d3-9620-1f2c393fd55a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:32.766742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-87cb1dab-53c9-42d3-9620-1f2c393fd55a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:32.774130 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-87cb1dab-53c9-42d3-9620-1f2c393fd55a tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1515 microversion: 2.1 time: 0.165171 Nov 16 19:03:32.774691 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 136/266] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:32 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:32.793685 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9ab7627c-e7e9-450a-b54c-e58e16036030 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43f621e6-f073-4390-b2ee-86e728e37de1"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:32.794848 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9ab7627c-e7e9-450a-b54c-e58e16036030 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:32.802055 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ab7627c-e7e9-450a-b54c-e58e16036030 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:32.802752 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ab7627c-e7e9-450a-b54c-e58e16036030 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:32.803734 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ab7627c-e7e9-450a-b54c-e58e16036030 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:32.804905 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ab7627c-e7e9-450a-b54c-e58e16036030 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:33.007169 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-77d7f9e4-34b8-46f9-aa54-ca5488ccdf0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:33.008447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-77d7f9e4-34b8-46f9-aa54-ca5488ccdf0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:33.014898 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77d7f9e4-34b8-46f9-aa54-ca5488ccdf0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:33.015350 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77d7f9e4-34b8-46f9-aa54-ca5488ccdf0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:33.016141 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77d7f9e4-34b8-46f9-aa54-ca5488ccdf0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:33.016611 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77d7f9e4-34b8-46f9-aa54-ca5488ccdf0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:33.095321 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9ab7627c-e7e9-450a-b54c-e58e16036030 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307435 Nov 16 19:03:33.100684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 131/267] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:03:32 2021] POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:33.111522 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-77d7f9e4-34b8-46f9-aa54-ca5488ccdf0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 27211 microversion: 2.20 time: 0.107806 Nov 16 19:03:33.116396 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 137/268] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:33 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 27211 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:33.280102 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1060279750", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:33.322850 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-83ac97a7-0936-4505-b3e0-2f2be52b6d4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:33.330500 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83ac97a7-0936-4505-b3e0-2f2be52b6d4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:33.330965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83ac97a7-0936-4505-b3e0-2f2be52b6d4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:33.333993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] validate_networks() for None {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:03:33.392549 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-83ac97a7-0936-4505-b3e0-2f2be52b6d4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Going to try to stop instance {{(pid=116168) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 16 19:03:33.441997 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-83ac97a7-0936-4505-b3e0-2f2be52b6d4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 202 len: 0 microversion: 2.1 time: 0.123574 Nov 16 19:03:33.442744 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 138/269] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:33 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:33.452220 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-70f2218d-047b-4c2d-bb14-fb637a196308 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:33.453006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-70f2218d-047b-4c2d-bb14-fb637a196308 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:33.460100 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-70f2218d-047b-4c2d-bb14-fb637a196308 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:33.461486 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-70f2218d-047b-4c2d-bb14-fb637a196308 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:33.462570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-70f2218d-047b-4c2d-bb14-fb637a196308 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:33.463199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-70f2218d-047b-4c2d-bb14-fb637a196308 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:33.602996 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-70f2218d-047b-4c2d-bb14-fb637a196308 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:33.611297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-70f2218d-047b-4c2d-bb14-fb637a196308 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.163332 Nov 16 19:03:33.611865 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 139/270] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:33 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:33.635098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:03:33.635518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:03:33.635990 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:03:33.636400 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:03:33.636812 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:03:33.645442 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:33.645919 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:33.646728 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:33.647160 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:33.663614 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Getting quotas for project d0220837a1f347fd84ac6cec0c0cc5d7. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:03:33.667771 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Getting quotas for user 5d400c9ec3a943c78f8b38f9475369f9 and project d0220837a1f347fd84ac6cec0c0cc5d7. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:03:33.682372 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:03:33.684779 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:03:33.726923 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-287a4b8f-fc13-4f18-b967-2a09a99f2bc8 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.451723 Nov 16 19:03:33.727576 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 132/271] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:03:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:03:33.737602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-06fe06dd-622a-46cb-9c5e-f75e42a7b63d tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:33.738304 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-06fe06dd-622a-46cb-9c5e-f75e42a7b63d tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:33.800786 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-06fe06dd-622a-46cb-9c5e-f75e42a7b63d tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:33.808382 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-06fe06dd-622a-46cb-9c5e-f75e42a7b63d tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1215 microversion: 2.1 time: 0.074565 Nov 16 19:03:33.808956 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 140/272] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:33 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:34.124552 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f7ef9189-718d-4b03-91b4-7a3b57c2630f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:34.125886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f7ef9189-718d-4b03-91b4-7a3b57c2630f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:34.133024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7ef9189-718d-4b03-91b4-7a3b57c2630f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:34.133867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7ef9189-718d-4b03-91b4-7a3b57c2630f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:34.134838 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7ef9189-718d-4b03-91b4-7a3b57c2630f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:34.135308 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7ef9189-718d-4b03-91b4-7a3b57c2630f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:34.256898 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f7ef9189-718d-4b03-91b4-7a3b57c2630f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 27651 microversion: 2.20 time: 0.136339 Nov 16 19:03:34.258756 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 133/273] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:34 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 27651 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:34.628835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-51292f69-4373-4c08-85a9-00bc9188bd52 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:34.629428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-51292f69-4373-4c08-85a9-00bc9188bd52 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:34.636598 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51292f69-4373-4c08-85a9-00bc9188bd52 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:34.637041 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51292f69-4373-4c08-85a9-00bc9188bd52 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:34.637832 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51292f69-4373-4c08-85a9-00bc9188bd52 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:34.638264 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51292f69-4373-4c08-85a9-00bc9188bd52 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:34.767259 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-51292f69-4373-4c08-85a9-00bc9188bd52 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:34.775947 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-51292f69-4373-4c08-85a9-00bc9188bd52 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.150634 Nov 16 19:03:34.776511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 141/274] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:34 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:34.826949 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f6c69987-9a7d-4799-93bd-3e284b174e1c tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:34.827648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f6c69987-9a7d-4799-93bd-3e284b174e1c tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:34.834541 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6c69987-9a7d-4799-93bd-3e284b174e1c tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:34.834985 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6c69987-9a7d-4799-93bd-3e284b174e1c tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:34.836444 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6c69987-9a7d-4799-93bd-3e284b174e1c tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:34.836849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6c69987-9a7d-4799-93bd-3e284b174e1c tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:34.902757 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f6c69987-9a7d-4799-93bd-3e284b174e1c tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:34.910580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f6c69987-9a7d-4799-93bd-3e284b174e1c tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1267 microversion: 2.1 time: 0.087637 Nov 16 19:03:34.911208 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 134/275] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:34 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:35.273307 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4a6ea936-2fa7-48a2-9fb9-0f5502316611 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:35.274638 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4a6ea936-2fa7-48a2-9fb9-0f5502316611 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:35.281209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4a6ea936-2fa7-48a2-9fb9-0f5502316611 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:35.282118 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4a6ea936-2fa7-48a2-9fb9-0f5502316611 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:35.283075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4a6ea936-2fa7-48a2-9fb9-0f5502316611 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:35.283746 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4a6ea936-2fa7-48a2-9fb9-0f5502316611 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:35.384588 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4a6ea936-2fa7-48a2-9fb9-0f5502316611 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 27849 microversion: 2.20 time: 0.117032 Nov 16 19:03:35.389492 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 142/276] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:35 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 27849 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:35.795266 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f04f6651-9e7e-40ab-8a06-a26b47c57f3f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:35.796792 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f04f6651-9e7e-40ab-8a06-a26b47c57f3f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:35.816320 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f04f6651-9e7e-40ab-8a06-a26b47c57f3f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:35.816776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f04f6651-9e7e-40ab-8a06-a26b47c57f3f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:35.819937 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f04f6651-9e7e-40ab-8a06-a26b47c57f3f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:35.820392 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f04f6651-9e7e-40ab-8a06-a26b47c57f3f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:35.952632 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8f59a692-0bd8-4b2a-b617-bf0bebce822e tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:35.955409 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8f59a692-0bd8-4b2a-b617-bf0bebce822e tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:35.979400 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f59a692-0bd8-4b2a-b617-bf0bebce822e tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:35.980121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f59a692-0bd8-4b2a-b617-bf0bebce822e tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:35.980982 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f59a692-0bd8-4b2a-b617-bf0bebce822e tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:35.981661 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f59a692-0bd8-4b2a-b617-bf0bebce822e tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:36.194956 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8f59a692-0bd8-4b2a-b617-bf0bebce822e tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:36.203081 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8f59a692-0bd8-4b2a-b617-bf0bebce822e tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1315 microversion: 2.1 time: 0.278698 Nov 16 19:03:36.203660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 143/277] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:35 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:36.246579 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f04f6651-9e7e-40ab-8a06-a26b47c57f3f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:36.254737 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f04f6651-9e7e-40ab-8a06-a26b47c57f3f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.464258 Nov 16 19:03:36.256350 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 135/278] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:35 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:36.396446 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0d07f30d-94e1-4788-86a0-83bb49a818f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:36.397699 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0d07f30d-94e1-4788-86a0-83bb49a818f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:36.405402 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d07f30d-94e1-4788-86a0-83bb49a818f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:36.406276 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d07f30d-94e1-4788-86a0-83bb49a818f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:36.407672 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d07f30d-94e1-4788-86a0-83bb49a818f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:36.408569 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d07f30d-94e1-4788-86a0-83bb49a818f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:36.535061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0d07f30d-94e1-4788-86a0-83bb49a818f1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28150 microversion: 2.20 time: 0.142308 Nov 16 19:03:36.538527 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 144/279] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:36 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28150 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:36.651701 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-084b33d5-455b-41eb-8262-130f17eff353 req-d480c110-6858-4ecd-9e73-34e895a617a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9172563d-3201-47f5-a944-04f8322b8135", "tag": "7180db56-4b84-44bb-a8ff-d69501154966"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:36.654230 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:03:36.654230 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:03:36.661867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-084b33d5-455b-41eb-8262-130f17eff353 req-d480c110-6858-4ecd-9e73-34e895a617a0 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:36.662957 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-084b33d5-455b-41eb-8262-130f17eff353 req-d480c110-6858-4ecd-9e73-34e895a617a0 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:36.682497 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-084b33d5-455b-41eb-8262-130f17eff353 req-d480c110-6858-4ecd-9e73-34e895a617a0 service nova] Creating event network-changed:7180db56-4b84-44bb-a8ff-d69501154966 for instance 9172563d-3201-47f5-a944-04f8322b8135 on hv-cinder-66710 Nov 16 19:03:36.688642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-084b33d5-455b-41eb-8262-130f17eff353 req-d480c110-6858-4ecd-9e73-34e895a617a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046098 Nov 16 19:03:36.689577 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 136/280] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:03:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:37.222935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a65d7f24-6c08-407d-a68c-dca4845006c3 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:37.224205 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a65d7f24-6c08-407d-a68c-dca4845006c3 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:37.236654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a65d7f24-6c08-407d-a68c-dca4845006c3 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:37.237452 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a65d7f24-6c08-407d-a68c-dca4845006c3 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:37.238887 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a65d7f24-6c08-407d-a68c-dca4845006c3 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:37.239773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a65d7f24-6c08-407d-a68c-dca4845006c3 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:37.273114 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-24683239-3ed0-447b-b0b9-b9ae5299fc69 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:37.273995 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-24683239-3ed0-447b-b0b9-b9ae5299fc69 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:37.280112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24683239-3ed0-447b-b0b9-b9ae5299fc69 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:37.280565 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24683239-3ed0-447b-b0b9-b9ae5299fc69 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:37.281349 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24683239-3ed0-447b-b0b9-b9ae5299fc69 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:37.281806 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24683239-3ed0-447b-b0b9-b9ae5299fc69 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:37.378782 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a65d7f24-6c08-407d-a68c-dca4845006c3 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:37.387026 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a65d7f24-6c08-407d-a68c-dca4845006c3 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1315 microversion: 2.1 time: 0.169564 Nov 16 19:03:37.387689 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 145/281] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:37 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:37.494720 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-24683239-3ed0-447b-b0b9-b9ae5299fc69 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:37.502408 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-24683239-3ed0-447b-b0b9-b9ae5299fc69 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.234021 Nov 16 19:03:37.503087 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 137/282] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:37 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:37.548239 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8c6c03b4-7a6b-46c9-b006-ca8dca4e041b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:37.549159 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8c6c03b4-7a6b-46c9-b006-ca8dca4e041b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:37.555134 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c6c03b4-7a6b-46c9-b006-ca8dca4e041b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:37.555583 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c6c03b4-7a6b-46c9-b006-ca8dca4e041b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:37.556370 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c6c03b4-7a6b-46c9-b006-ca8dca4e041b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:37.556800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c6c03b4-7a6b-46c9-b006-ca8dca4e041b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:37.675038 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8c6c03b4-7a6b-46c9-b006-ca8dca4e041b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28159 microversion: 2.20 time: 0.130411 Nov 16 19:03:37.678896 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 146/283] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:37 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28159 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:38.403550 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-677aa6ea-577d-4e89-956c-da4fd66e8f76 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:38.404170 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-677aa6ea-577d-4e89-956c-da4fd66e8f76 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:38.410611 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-677aa6ea-577d-4e89-956c-da4fd66e8f76 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:38.411178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-677aa6ea-577d-4e89-956c-da4fd66e8f76 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:38.411809 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-677aa6ea-577d-4e89-956c-da4fd66e8f76 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:38.412235 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-677aa6ea-577d-4e89-956c-da4fd66e8f76 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:38.519740 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7e0ae45f-dedc-4e2a-828c-7e45678aec2f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:38.520432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7e0ae45f-dedc-4e2a-828c-7e45678aec2f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:38.527427 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e0ae45f-dedc-4e2a-828c-7e45678aec2f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:38.527877 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e0ae45f-dedc-4e2a-828c-7e45678aec2f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:38.528660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e0ae45f-dedc-4e2a-828c-7e45678aec2f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:38.529099 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e0ae45f-dedc-4e2a-828c-7e45678aec2f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:38.545791 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-677aa6ea-577d-4e89-956c-da4fd66e8f76 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:38.553456 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-677aa6ea-577d-4e89-956c-da4fd66e8f76 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1315 microversion: 2.1 time: 0.153467 Nov 16 19:03:38.554765 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 138/284] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:38 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:38.672559 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7e0ae45f-dedc-4e2a-828c-7e45678aec2f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:38.681120 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7e0ae45f-dedc-4e2a-828c-7e45678aec2f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.165437 Nov 16 19:03:38.682208 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 147/285] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:38 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:38.688591 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-be4d76ff-fb1a-45b8-ac3b-5ae6458a9012 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:38.689799 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-be4d76ff-fb1a-45b8-ac3b-5ae6458a9012 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:38.696331 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-be4d76ff-fb1a-45b8-ac3b-5ae6458a9012 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:38.696851 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-be4d76ff-fb1a-45b8-ac3b-5ae6458a9012 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:38.697792 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-be4d76ff-fb1a-45b8-ac3b-5ae6458a9012 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:38.698284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-be4d76ff-fb1a-45b8-ac3b-5ae6458a9012 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:38.778945 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-be4d76ff-fb1a-45b8-ac3b-5ae6458a9012 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28159 microversion: 2.20 time: 0.095569 Nov 16 19:03:38.780270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 139/286] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:38 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28159 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:39.570072 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-773bd413-2802-4d74-a37e-a3b6cb493e68 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:39.570853 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-773bd413-2802-4d74-a37e-a3b6cb493e68 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:39.577026 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-773bd413-2802-4d74-a37e-a3b6cb493e68 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:39.577476 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-773bd413-2802-4d74-a37e-a3b6cb493e68 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:39.578314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-773bd413-2802-4d74-a37e-a3b6cb493e68 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:39.578751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-773bd413-2802-4d74-a37e-a3b6cb493e68 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:39.699345 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c90879ce-1aa5-481e-b759-5adf61f209fb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:39.700044 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c90879ce-1aa5-481e-b759-5adf61f209fb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:39.707681 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c90879ce-1aa5-481e-b759-5adf61f209fb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:39.708194 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c90879ce-1aa5-481e-b759-5adf61f209fb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:39.709194 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c90879ce-1aa5-481e-b759-5adf61f209fb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:39.710060 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c90879ce-1aa5-481e-b759-5adf61f209fb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:39.711774 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-773bd413-2802-4d74-a37e-a3b6cb493e68 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:39.719294 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-773bd413-2802-4d74-a37e-a3b6cb493e68 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1315 microversion: 2.1 time: 0.152748 Nov 16 19:03:39.720478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 148/287] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:39 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:39.790996 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-af6938a9-fa95-443d-8211-edbb2e5a06f4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:39.791886 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-af6938a9-fa95-443d-8211-edbb2e5a06f4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:39.800005 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af6938a9-fa95-443d-8211-edbb2e5a06f4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:39.800754 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af6938a9-fa95-443d-8211-edbb2e5a06f4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:39.801871 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af6938a9-fa95-443d-8211-edbb2e5a06f4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:39.802429 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af6938a9-fa95-443d-8211-edbb2e5a06f4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:39.858898 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c90879ce-1aa5-481e-b759-5adf61f209fb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:39.866852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c90879ce-1aa5-481e-b759-5adf61f209fb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.171513 Nov 16 19:03:39.867550 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 140/288] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:39 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:39.882906 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-af6938a9-fa95-443d-8211-edbb2e5a06f4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28159 microversion: 2.20 time: 0.096026 Nov 16 19:03:39.883907 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 149/289] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:39 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28159 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:40.595299 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0dfeef32-6caa-473b-a14e-f4d92ec4748c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:40.596234 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0dfeef32-6caa-473b-a14e-f4d92ec4748c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:40.602760 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0dfeef32-6caa-473b-a14e-f4d92ec4748c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:40.603205 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0dfeef32-6caa-473b-a14e-f4d92ec4748c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:40.603980 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0dfeef32-6caa-473b-a14e-f4d92ec4748c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:40.604411 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0dfeef32-6caa-473b-a14e-f4d92ec4748c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:40.628876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-0dfeef32-6caa-473b-a14e-f4d92ec4748c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lazy-loading 'flavor' on Instance uuid c22ea69e-6ab3-4ba5-b12b-f940430d6649 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:03:40.737808 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e2ab4542-cd0f-45b5-be74-50f9845a7704 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:40.738510 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e2ab4542-cd0f-45b5-be74-50f9845a7704 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:40.746288 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2ab4542-cd0f-45b5-be74-50f9845a7704 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:40.746740 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2ab4542-cd0f-45b5-be74-50f9845a7704 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:40.747576 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2ab4542-cd0f-45b5-be74-50f9845a7704 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:40.748012 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2ab4542-cd0f-45b5-be74-50f9845a7704 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:40.748792 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0dfeef32-6caa-473b-a14e-f4d92ec4748c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/action" status: 200 len: 32 microversion: 2.1 time: 0.157203 Nov 16 19:03:40.749751 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 141/290] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:03:40 2021] POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:03:40.760495 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3409a4c3-309a-49e3-8ffc-5d5012933efc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:40.761353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3409a4c3-309a-49e3-8ffc-5d5012933efc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:40.769120 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3409a4c3-309a-49e3-8ffc-5d5012933efc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:40.769649 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3409a4c3-309a-49e3-8ffc-5d5012933efc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:40.770434 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3409a4c3-309a-49e3-8ffc-5d5012933efc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:40.770900 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3409a4c3-309a-49e3-8ffc-5d5012933efc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:40.890650 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e2ab4542-cd0f-45b5-be74-50f9845a7704 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:40.898429 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e2ab4542-cd0f-45b5-be74-50f9845a7704 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1315 microversion: 2.1 time: 0.164646 Nov 16 19:03:40.899002 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 150/291] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:40 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:40.903346 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-09dd47c7-06c0-41b1-9d2c-c6ebddd4135b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:40.903954 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-09dd47c7-06c0-41b1-9d2c-c6ebddd4135b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:40.910166 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09dd47c7-06c0-41b1-9d2c-c6ebddd4135b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:40.910613 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09dd47c7-06c0-41b1-9d2c-c6ebddd4135b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:40.911408 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09dd47c7-06c0-41b1-9d2c-c6ebddd4135b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:40.911844 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09dd47c7-06c0-41b1-9d2c-c6ebddd4135b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:41.048965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-09dd47c7-06c0-41b1-9d2c-c6ebddd4135b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:41.059482 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-09dd47c7-06c0-41b1-9d2c-c6ebddd4135b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.159312 Nov 16 19:03:41.060180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 151/292] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:40 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:41.067521 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-04a3b2c0-a020-426f-a7db-0048a6276a31 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:41.068808 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-04a3b2c0-a020-426f-a7db-0048a6276a31 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:41.075360 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-04a3b2c0-a020-426f-a7db-0048a6276a31 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:41.075814 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-04a3b2c0-a020-426f-a7db-0048a6276a31 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:41.076609 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-04a3b2c0-a020-426f-a7db-0048a6276a31 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:41.077052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-04a3b2c0-a020-426f-a7db-0048a6276a31 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:41.166648 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-04a3b2c0-a020-426f-a7db-0048a6276a31 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28450 microversion: 2.20 time: 0.105119 Nov 16 19:03:41.170757 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 152/293] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:41 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28450 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:41.193522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3409a4c3-309a-49e3-8ffc-5d5012933efc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:41.201458 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3409a4c3-309a-49e3-8ffc-5d5012933efc tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.446269 Nov 16 19:03:41.202072 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 142/294] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:40 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:41.915521 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-62be8d2c-a664-47e9-bb3c-9acfd1795bc5 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:41.916890 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-62be8d2c-a664-47e9-bb3c-9acfd1795bc5 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:41.923728 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62be8d2c-a664-47e9-bb3c-9acfd1795bc5 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:41.925721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62be8d2c-a664-47e9-bb3c-9acfd1795bc5 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:41.925721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62be8d2c-a664-47e9-bb3c-9acfd1795bc5 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:41.925721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62be8d2c-a664-47e9-bb3c-9acfd1795bc5 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:42.052196 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-62be8d2c-a664-47e9-bb3c-9acfd1795bc5 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:42.060559 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-62be8d2c-a664-47e9-bb3c-9acfd1795bc5 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1315 microversion: 2.1 time: 0.149080 Nov 16 19:03:42.061124 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 153/295] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:41 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:42.077537 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9de84cc7-6de4-4f75-a383-4b9703c34d4a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:42.078302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9de84cc7-6de4-4f75-a383-4b9703c34d4a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:42.084491 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9de84cc7-6de4-4f75-a383-4b9703c34d4a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:42.084940 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9de84cc7-6de4-4f75-a383-4b9703c34d4a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:42.085744 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9de84cc7-6de4-4f75-a383-4b9703c34d4a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:42.086178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9de84cc7-6de4-4f75-a383-4b9703c34d4a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:42.178190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d315d861-a00f-45c5-b388-f46bf66d5a88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:42.179109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d315d861-a00f-45c5-b388-f46bf66d5a88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:42.186035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d315d861-a00f-45c5-b388-f46bf66d5a88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:42.186478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d315d861-a00f-45c5-b388-f46bf66d5a88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:42.187269 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d315d861-a00f-45c5-b388-f46bf66d5a88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:42.187704 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d315d861-a00f-45c5-b388-f46bf66d5a88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:42.220906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9de84cc7-6de4-4f75-a383-4b9703c34d4a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:42.229224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9de84cc7-6de4-4f75-a383-4b9703c34d4a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.155329 Nov 16 19:03:42.229816 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 143/296] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:42 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:42.234289 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ed89692c-c0a9-489d-8190-dde3628ec8f5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:42.234907 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ed89692c-c0a9-489d-8190-dde3628ec8f5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:42.240436 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ed89692c-c0a9-489d-8190-dde3628ec8f5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:42.240879 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ed89692c-c0a9-489d-8190-dde3628ec8f5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:42.241676 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ed89692c-c0a9-489d-8190-dde3628ec8f5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:42.242690 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ed89692c-c0a9-489d-8190-dde3628ec8f5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:42.263822 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d315d861-a00f-45c5-b388-f46bf66d5a88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28450 microversion: 2.20 time: 0.088953 Nov 16 19:03:42.264496 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 154/297] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:42 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28450 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:42.374593 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ed89692c-c0a9-489d-8190-dde3628ec8f5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:42.382305 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ed89692c-c0a9-489d-8190-dde3628ec8f5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.151561 Nov 16 19:03:42.382869 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 144/298] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:42 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:43.078052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0299dc57-64fa-47f1-bd1b-afafae57e039 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:43.078752 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0299dc57-64fa-47f1-bd1b-afafae57e039 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:43.085621 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0299dc57-64fa-47f1-bd1b-afafae57e039 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.086659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0299dc57-64fa-47f1-bd1b-afafae57e039 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.087440 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0299dc57-64fa-47f1-bd1b-afafae57e039 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.087872 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0299dc57-64fa-47f1-bd1b-afafae57e039 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.224000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0299dc57-64fa-47f1-bd1b-afafae57e039 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:43.231493 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0299dc57-64fa-47f1-bd1b-afafae57e039 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1315 microversion: 2.1 time: 0.157555 Nov 16 19:03:43.239342 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 155/299] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:43 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:43.246481 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-47f996f7-2124-4518-925d-1d52ac3f4501 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:43.247079 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-47f996f7-2124-4518-925d-1d52ac3f4501 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:43.253202 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47f996f7-2124-4518-925d-1d52ac3f4501 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.253679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47f996f7-2124-4518-925d-1d52ac3f4501 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.254456 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47f996f7-2124-4518-925d-1d52ac3f4501 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.254880 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47f996f7-2124-4518-925d-1d52ac3f4501 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.276465 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-24195d6f-0098-4e75-aea6-2549a9145df5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:43.277777 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-24195d6f-0098-4e75-aea6-2549a9145df5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:43.283344 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24195d6f-0098-4e75-aea6-2549a9145df5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.283781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24195d6f-0098-4e75-aea6-2549a9145df5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.284567 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24195d6f-0098-4e75-aea6-2549a9145df5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.285194 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24195d6f-0098-4e75-aea6-2549a9145df5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.379555 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-24195d6f-0098-4e75-aea6-2549a9145df5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28618 microversion: 2.20 time: 0.107272 Nov 16 19:03:43.384589 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 156/300] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:43 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28618 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:43.386146 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-7d4a76d7-f632-4b07-833a-d805ef2a29f6 req-1f6efe27-a47a-48c6-80b1-f3961babd191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9172563d-3201-47f5-a944-04f8322b8135", "name": "network-vif-plugged", "status": "completed", "tag": "7180db56-4b84-44bb-a8ff-d69501154966"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:43.388175 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:03:43.388175 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:03:43.397280 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-7d4a76d7-f632-4b07-833a-d805ef2a29f6 req-1f6efe27-a47a-48c6-80b1-f3961babd191 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.397710 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-7d4a76d7-f632-4b07-833a-d805ef2a29f6 req-1f6efe27-a47a-48c6-80b1-f3961babd191 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.404428 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-47f996f7-2124-4518-925d-1d52ac3f4501 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:43.409223 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-7d4a76d7-f632-4b07-833a-d805ef2a29f6 req-1f6efe27-a47a-48c6-80b1-f3961babd191 service nova] Creating event network-vif-plugged:7180db56-4b84-44bb-a8ff-d69501154966 for instance 9172563d-3201-47f5-a944-04f8322b8135 on hv-cinder-66710 Nov 16 19:03:43.413968 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-47f996f7-2124-4518-925d-1d52ac3f4501 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.171088 Nov 16 19:03:43.414143 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-7d4a76d7-f632-4b07-833a-d805ef2a29f6 req-1f6efe27-a47a-48c6-80b1-f3961babd191 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032590 Nov 16 19:03:43.414782 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 157/301] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:03:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:43.419046 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 145/302] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:43 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:43.419515 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2a401000-65e3-4319-b19a-479e0ad12a57 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:43.420186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2a401000-65e3-4319-b19a-479e0ad12a57 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:43.426126 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2a401000-65e3-4319-b19a-479e0ad12a57 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.426572 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2a401000-65e3-4319-b19a-479e0ad12a57 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.427460 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2a401000-65e3-4319-b19a-479e0ad12a57 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:43.427926 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2a401000-65e3-4319-b19a-479e0ad12a57 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:43.569005 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2a401000-65e3-4319-b19a-479e0ad12a57 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:43.578682 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2a401000-65e3-4319-b19a-479e0ad12a57 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.162589 Nov 16 19:03:43.579627 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 158/303] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:43 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:44.248737 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-269d0ea4-de2d-43b6-83bb-f25b660b34d9 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:44.249339 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-269d0ea4-de2d-43b6-83bb-f25b660b34d9 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:44.255586 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-269d0ea4-de2d-43b6-83bb-f25b660b34d9 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:44.256032 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-269d0ea4-de2d-43b6-83bb-f25b660b34d9 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:44.256827 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-269d0ea4-de2d-43b6-83bb-f25b660b34d9 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:44.257239 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-269d0ea4-de2d-43b6-83bb-f25b660b34d9 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:44.392697 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-05b50d4c-3352-41a8-9bf8-d3b8ba77f8bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:44.393729 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-05b50d4c-3352-41a8-9bf8-d3b8ba77f8bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:44.400664 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05b50d4c-3352-41a8-9bf8-d3b8ba77f8bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:44.401031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05b50d4c-3352-41a8-9bf8-d3b8ba77f8bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:44.402134 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05b50d4c-3352-41a8-9bf8-d3b8ba77f8bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:44.402773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-05b50d4c-3352-41a8-9bf8-d3b8ba77f8bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:44.408201 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-269d0ea4-de2d-43b6-83bb-f25b660b34d9 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:44.415846 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-269d0ea4-de2d-43b6-83bb-f25b660b34d9 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1315 microversion: 2.1 time: 0.170750 Nov 16 19:03:44.425762 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 146/304] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:44 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:44.431548 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c0e0bc4e-464f-44ba-b55b-6523df3d1bd1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:44.432440 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c0e0bc4e-464f-44ba-b55b-6523df3d1bd1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:44.439623 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c0e0bc4e-464f-44ba-b55b-6523df3d1bd1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:44.440266 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c0e0bc4e-464f-44ba-b55b-6523df3d1bd1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:44.441229 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c0e0bc4e-464f-44ba-b55b-6523df3d1bd1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:44.441694 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c0e0bc4e-464f-44ba-b55b-6523df3d1bd1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:44.483412 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-05b50d4c-3352-41a8-9bf8-d3b8ba77f8bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28618 microversion: 2.20 time: 0.094781 Nov 16 19:03:44.484096 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 159/305] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:44 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28618 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:44.576147 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c0e0bc4e-464f-44ba-b55b-6523df3d1bd1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:44.583813 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c0e0bc4e-464f-44ba-b55b-6523df3d1bd1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.156384 Nov 16 19:03:44.584379 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 147/306] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:44 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:44.596365 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bab1e31b-5d15-4700-b7ea-7033ef3a5a6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:44.597061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bab1e31b-5d15-4700-b7ea-7033ef3a5a6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:44.604956 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bab1e31b-5d15-4700-b7ea-7033ef3a5a6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:44.605403 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bab1e31b-5d15-4700-b7ea-7033ef3a5a6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:44.606209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bab1e31b-5d15-4700-b7ea-7033ef3a5a6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:44.606645 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bab1e31b-5d15-4700-b7ea-7033ef3a5a6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:44.745939 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bab1e31b-5d15-4700-b7ea-7033ef3a5a6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:44.753996 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bab1e31b-5d15-4700-b7ea-7033ef3a5a6e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.161566 Nov 16 19:03:44.754560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 160/307] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:44 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:45.433071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-423ac37c-32a2-4169-9bc2-8f7f689d5b54 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:45.433810 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-423ac37c-32a2-4169-9bc2-8f7f689d5b54 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:45.440314 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-423ac37c-32a2-4169-9bc2-8f7f689d5b54 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.440764 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-423ac37c-32a2-4169-9bc2-8f7f689d5b54 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.441646 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-423ac37c-32a2-4169-9bc2-8f7f689d5b54 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.442082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-423ac37c-32a2-4169-9bc2-8f7f689d5b54 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.495215 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e5d1f02d-46f1-48d8-ac0e-7766c0148221 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:45.496327 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e5d1f02d-46f1-48d8-ac0e-7766c0148221 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:45.502890 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e5d1f02d-46f1-48d8-ac0e-7766c0148221 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.503413 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e5d1f02d-46f1-48d8-ac0e-7766c0148221 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.504263 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e5d1f02d-46f1-48d8-ac0e-7766c0148221 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.504782 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e5d1f02d-46f1-48d8-ac0e-7766c0148221 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.576871 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e5d1f02d-46f1-48d8-ac0e-7766c0148221 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28618 microversion: 2.20 time: 0.085109 Nov 16 19:03:45.577903 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 161/308] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:45 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28618 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:45.602689 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ee654be7-2795-41cf-b305-1ca831fc46a7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:45.603478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ee654be7-2795-41cf-b305-1ca831fc46a7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:45.610468 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee654be7-2795-41cf-b305-1ca831fc46a7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.611002 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee654be7-2795-41cf-b305-1ca831fc46a7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.611791 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee654be7-2795-41cf-b305-1ca831fc46a7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.612218 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee654be7-2795-41cf-b305-1ca831fc46a7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.680740 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-423ac37c-32a2-4169-9bc2-8f7f689d5b54 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:45.688787 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-423ac37c-32a2-4169-9bc2-8f7f689d5b54 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1465 microversion: 2.1 time: 0.260381 Nov 16 19:03:45.689366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 148/309] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:45 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1465 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:45.728852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5eb8e92d-5006-4325-819f-643df49f6088 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:45.729532 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5eb8e92d-5006-4325-819f-643df49f6088 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:45.736112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5eb8e92d-5006-4325-819f-643df49f6088 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.736550 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5eb8e92d-5006-4325-819f-643df49f6088 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.737332 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5eb8e92d-5006-4325-819f-643df49f6088 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.737838 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5eb8e92d-5006-4325-819f-643df49f6088 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.755854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ee654be7-2795-41cf-b305-1ca831fc46a7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:45.765189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ee654be7-2795-41cf-b305-1ca831fc46a7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.166381 Nov 16 19:03:45.766025 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5eb8e92d-5006-4325-819f-643df49f6088 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:03:45.775797 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 162/310] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:45 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:45.780888 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5d4f4e29-fa33-4993-a3f9-b3915d42cfe2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:45.781418 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5d4f4e29-fa33-4993-a3f9-b3915d42cfe2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:45.787590 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5d4f4e29-fa33-4993-a3f9-b3915d42cfe2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.788206 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5d4f4e29-fa33-4993-a3f9-b3915d42cfe2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.789033 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5d4f4e29-fa33-4993-a3f9-b3915d42cfe2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.789731 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5d4f4e29-fa33-4993-a3f9-b3915d42cfe2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.860775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5eb8e92d-5006-4325-819f-643df49f6088 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 204 len: 0 microversion: 2.1 time: 0.136460 Nov 16 19:03:45.861572 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 149/311] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:03:45 2021] DELETE /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:03:45.871093 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a45848e5-247b-447f-ac80-b7a2a6ecbfef tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:45.872118 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a45848e5-247b-447f-ac80-b7a2a6ecbfef tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:45.879278 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a45848e5-247b-447f-ac80-b7a2a6ecbfef tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.880007 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a45848e5-247b-447f-ac80-b7a2a6ecbfef tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.881013 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a45848e5-247b-447f-ac80-b7a2a6ecbfef tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:45.881617 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a45848e5-247b-447f-ac80-b7a2a6ecbfef tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:45.973239 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5d4f4e29-fa33-4993-a3f9-b3915d42cfe2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:45.981418 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5d4f4e29-fa33-4993-a3f9-b3915d42cfe2 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.204260 Nov 16 19:03:45.982540 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 163/312] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:45 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:46.055637 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a45848e5-247b-447f-ac80-b7a2a6ecbfef tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:46.063613 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a45848e5-247b-447f-ac80-b7a2a6ecbfef tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1471 microversion: 2.1 time: 0.197404 Nov 16 19:03:46.064395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 150/313] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:45 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:46.588943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f94c058a-a28c-4b48-a64e-e170b303c50e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:46.589802 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f94c058a-a28c-4b48-a64e-e170b303c50e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:46.596701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f94c058a-a28c-4b48-a64e-e170b303c50e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:46.597168 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f94c058a-a28c-4b48-a64e-e170b303c50e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:46.597960 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f94c058a-a28c-4b48-a64e-e170b303c50e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:46.598393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f94c058a-a28c-4b48-a64e-e170b303c50e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:46.671930 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f94c058a-a28c-4b48-a64e-e170b303c50e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28618 microversion: 2.20 time: 0.087247 Nov 16 19:03:46.672560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 164/314] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:46 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28618 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:46.782591 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ab176d57-64ec-440d-8fe1-79ebb091fd8f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:46.783339 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ab176d57-64ec-440d-8fe1-79ebb091fd8f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:46.789271 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ab176d57-64ec-440d-8fe1-79ebb091fd8f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:46.789758 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ab176d57-64ec-440d-8fe1-79ebb091fd8f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:46.790518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ab176d57-64ec-440d-8fe1-79ebb091fd8f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:46.790962 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ab176d57-64ec-440d-8fe1-79ebb091fd8f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:46.921892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ab176d57-64ec-440d-8fe1-79ebb091fd8f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:46.929610 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ab176d57-64ec-440d-8fe1-79ebb091fd8f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.150830 Nov 16 19:03:46.930178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 151/315] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:46 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:46.998310 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9924e708-7b91-4349-9862-f55db9db869e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:46.998997 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9924e708-7b91-4349-9862-f55db9db869e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:47.005753 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9924e708-7b91-4349-9862-f55db9db869e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.006199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9924e708-7b91-4349-9862-f55db9db869e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.006965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9924e708-7b91-4349-9862-f55db9db869e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.007913 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9924e708-7b91-4349-9862-f55db9db869e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.082269 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5f5c9efd-b05b-4e8c-ae9b-0fcd5d379292 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:47.083438 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5f5c9efd-b05b-4e8c-ae9b-0fcd5d379292 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:47.090043 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5f5c9efd-b05b-4e8c-ae9b-0fcd5d379292 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.090480 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5f5c9efd-b05b-4e8c-ae9b-0fcd5d379292 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.091293 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5f5c9efd-b05b-4e8c-ae9b-0fcd5d379292 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.091679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5f5c9efd-b05b-4e8c-ae9b-0fcd5d379292 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.139561 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9924e708-7b91-4349-9862-f55db9db869e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:47.147519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9924e708-7b91-4349-9862-f55db9db869e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.153161 Nov 16 19:03:47.148089 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 165/316] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:46 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:47.219168 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5f5c9efd-b05b-4e8c-ae9b-0fcd5d379292 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:47.226438 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5f5c9efd-b05b-4e8c-ae9b-0fcd5d379292 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1471 microversion: 2.1 time: 0.147857 Nov 16 19:03:47.226988 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 152/317] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:47 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:47.461399 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2088285560", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "734c5c23-6b90-4051-923f-6327396b1039"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:47.513651 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] validate_networks() for [('734c5c23-6b90-4051-923f-6327396b1039', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:03:47.684416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9a993439-b505-4876-882d-9012c9e21f0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:47.685416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9a993439-b505-4876-882d-9012c9e21f0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:47.691146 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a993439-b505-4876-882d-9012c9e21f0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.691598 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a993439-b505-4876-882d-9012c9e21f0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.692375 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a993439-b505-4876-882d-9012c9e21f0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.693254 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9a993439-b505-4876-882d-9012c9e21f0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.760837 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9a993439-b505-4876-882d-9012c9e21f0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 28618 microversion: 2.20 time: 0.079973 Nov 16 19:03:47.763074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 153/318] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:47 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 28618 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:47.855780 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:03:47.856457 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:03:47.857047 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:03:47.857533 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:03:47.857965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:03:47.866312 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.867503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.868299 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.868724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.884831 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Getting quotas for project 16e9cbea1c0e436b8c518eaa18d7b74c. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:03:47.888941 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Getting quotas for user 6f7dbeb8d8c143bd97ff13e0be4b4fb0 and project 16e9cbea1c0e436b8c518eaa18d7b74c. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:03:47.900382 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:03:47.902742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:03:47.947469 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bba9dd11-4743-47da-a5e9-81c47d19b748 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:47.948859 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bba9dd11-4743-47da-a5e9-81c47d19b748 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:47.950999 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-73a83239-5dfa-4bda-a248-1f75c7a51c6b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493151 Nov 16 19:03:47.951871 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 166/319] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:03:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:03:47.962032 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bba9dd11-4743-47da-a5e9-81c47d19b748 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.963474 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c6772df2-fa5d-4c32-b4e0-9f4ff8f7f89c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:47.963747 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bba9dd11-4743-47da-a5e9-81c47d19b748 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:47.964134 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c6772df2-fa5d-4c32-b4e0-9f4ff8f7f89c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:47.965031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bba9dd11-4743-47da-a5e9-81c47d19b748 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:47.965891 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bba9dd11-4743-47da-a5e9-81c47d19b748 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.040961 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c6772df2-fa5d-4c32-b4e0-9f4ff8f7f89c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:48.049749 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c6772df2-fa5d-4c32-b4e0-9f4ff8f7f89c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1219 microversion: 2.1 time: 0.091196 Nov 16 19:03:48.058273 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 167/320] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:47 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:48.127602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-962b63ed-c0f9-462e-9fc6-247d41daebf5 req-e74486b7-77ed-4f17-b8b2-be8e25414fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9172563d-3201-47f5-a944-04f8322b8135", "name": "network-vif-deleted", "tag": "7180db56-4b84-44bb-a8ff-d69501154966"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:48.130855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:03:48.130855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:03:48.139493 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-962b63ed-c0f9-462e-9fc6-247d41daebf5 req-e74486b7-77ed-4f17-b8b2-be8e25414fdb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:48.139879 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-962b63ed-c0f9-462e-9fc6-247d41daebf5 req-e74486b7-77ed-4f17-b8b2-be8e25414fdb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.152383 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-962b63ed-c0f9-462e-9fc6-247d41daebf5 req-e74486b7-77ed-4f17-b8b2-be8e25414fdb service nova] Creating event network-vif-deleted:7180db56-4b84-44bb-a8ff-d69501154966 for instance 9172563d-3201-47f5-a944-04f8322b8135 on hv-cinder-66710 Nov 16 19:03:48.157310 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-962b63ed-c0f9-462e-9fc6-247d41daebf5 req-e74486b7-77ed-4f17-b8b2-be8e25414fdb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035226 Nov 16 19:03:48.159023 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 168/321] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:03:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:03:48.165958 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e1b7fc22-9b82-43cb-8280-72a4c3a748d4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:48.166763 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e1b7fc22-9b82-43cb-8280-72a4c3a748d4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:48.176897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e1b7fc22-9b82-43cb-8280-72a4c3a748d4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:48.177517 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e1b7fc22-9b82-43cb-8280-72a4c3a748d4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.178561 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e1b7fc22-9b82-43cb-8280-72a4c3a748d4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:48.179475 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e1b7fc22-9b82-43cb-8280-72a4c3a748d4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.254784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bba9dd11-4743-47da-a5e9-81c47d19b748 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:48.264527 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bba9dd11-4743-47da-a5e9-81c47d19b748 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.321269 Nov 16 19:03:48.266015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 154/322] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:47 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:48.272163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:48.273701 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:48.280788 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:48.281747 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.282742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:48.283273 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.362961 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e1b7fc22-9b82-43cb-8280-72a4c3a748d4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:48.371416 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e1b7fc22-9b82-43cb-8280-72a4c3a748d4 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.211039 Nov 16 19:03:48.372326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 169/323] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:48 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:48.459046 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:48.459396 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.459818 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lazy-loading 'fault' on Instance uuid 9172563d-3201-47f5-a944-04f8322b8135 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:03:48.502084 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d400c9ec3a943c78f8b38f9475369f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0220837a1f347fd84ac6cec0c0cc5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:48.511761 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-59768cb4-62b1-4f76-bc7a-2f2c8d8c0075 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 200 len: 1305 microversion: 2.1 time: 0.244500 Nov 16 19:03:48.512532 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 155/324] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:48 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 1305 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:48.772698 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2c4032c5-30ac-4501-92d6-a308f7504063 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:48.773614 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2c4032c5-30ac-4501-92d6-a308f7504063 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:48.779618 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c4032c5-30ac-4501-92d6-a308f7504063 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:48.780066 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c4032c5-30ac-4501-92d6-a308f7504063 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.780888 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c4032c5-30ac-4501-92d6-a308f7504063 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:48.781322 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c4032c5-30ac-4501-92d6-a308f7504063 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:48.867866 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2c4032c5-30ac-4501-92d6-a308f7504063 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 29803 microversion: 2.20 time: 0.098321 Nov 16 19:03:48.868518 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 170/325] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:48 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 29803 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:49.066967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-99b522ab-fbfa-4bc2-9a29-a3cfbbe04804 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:49.067507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-99b522ab-fbfa-4bc2-9a29-a3cfbbe04804 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:49.074541 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99b522ab-fbfa-4bc2-9a29-a3cfbbe04804 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.074984 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99b522ab-fbfa-4bc2-9a29-a3cfbbe04804 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.075778 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99b522ab-fbfa-4bc2-9a29-a3cfbbe04804 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.076204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99b522ab-fbfa-4bc2-9a29-a3cfbbe04804 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.140718 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-99b522ab-fbfa-4bc2-9a29-a3cfbbe04804 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:49.148957 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-99b522ab-fbfa-4bc2-9a29-a3cfbbe04804 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1271 microversion: 2.1 time: 0.085711 Nov 16 19:03:49.149517 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 156/326] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:49 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:49.283444 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f1a5bf7c-94d9-48e7-b478-310065ceaab0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:49.284302 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f1a5bf7c-94d9-48e7-b478-310065ceaab0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:49.291777 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f1a5bf7c-94d9-48e7-b478-310065ceaab0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.292256 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f1a5bf7c-94d9-48e7-b478-310065ceaab0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.293172 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f1a5bf7c-94d9-48e7-b478-310065ceaab0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.293798 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f1a5bf7c-94d9-48e7-b478-310065ceaab0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.388085 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-adf5e2e3-41e3-4fea-a648-8ccdfe65dfcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:49.388688 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-adf5e2e3-41e3-4fea-a648-8ccdfe65dfcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:49.394477 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-adf5e2e3-41e3-4fea-a648-8ccdfe65dfcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.394923 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-adf5e2e3-41e3-4fea-a648-8ccdfe65dfcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.396100 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-adf5e2e3-41e3-4fea-a648-8ccdfe65dfcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.396287 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-adf5e2e3-41e3-4fea-a648-8ccdfe65dfcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.432757 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f1a5bf7c-94d9-48e7-b478-310065ceaab0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:49.440450 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f1a5bf7c-94d9-48e7-b478-310065ceaab0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.161198 Nov 16 19:03:49.441018 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 171/327] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:49 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:49.528573 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:49.529179 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] [instance: 9172563d-3201-47f5-a944-04f8322b8135] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:49.535042 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.535497 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.536286 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.536724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.552190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] HTTP exception thrown: Instance 9172563d-3201-47f5-a944-04f8322b8135 could not be found. Nov 16 19:03:49.552887 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] Returning 404 to user: Instance 9172563d-3201-47f5-a944-04f8322b8135 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:03:49.554276 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c311752a-5a7a-44cd-9171-7521b7686e18 tempest-VolumesNegativeTest-1295834854 tempest-VolumesNegativeTest-1295834854-project] 10.222.0.46 "GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135" status: 404 len: 111 microversion: 2.1 time: 0.028763 Nov 16 19:03:49.554276 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 172/328] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:49 2021] GET /compute/v2.1/servers/9172563d-3201-47f5-a944-04f8322b8135 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 19:03:49.620663 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-adf5e2e3-41e3-4fea-a648-8ccdfe65dfcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:49.629861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-adf5e2e3-41e3-4fea-a648-8ccdfe65dfcd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.245253 Nov 16 19:03:49.630618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 157/329] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:49 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:49.879729 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2b6a98a7-d408-43b2-90b3-39cb33c5f765 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:49.881296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2b6a98a7-d408-43b2-90b3-39cb33c5f765 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:49.890061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b6a98a7-d408-43b2-90b3-39cb33c5f765 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.890642 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b6a98a7-d408-43b2-90b3-39cb33c5f765 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.892165 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b6a98a7-d408-43b2-90b3-39cb33c5f765 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:49.892715 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b6a98a7-d408-43b2-90b3-39cb33c5f765 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:49.975264 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2b6a98a7-d408-43b2-90b3-39cb33c5f765 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 31401 microversion: 2.20 time: 0.099338 Nov 16 19:03:49.976578 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 173/330] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:49 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 31401 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:50.170615 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-21a9eff2-4bfe-4f81-a03e-0752c487f5e8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:50.171221 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-21a9eff2-4bfe-4f81-a03e-0752c487f5e8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:50.182397 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-21a9eff2-4bfe-4f81-a03e-0752c487f5e8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.182397 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-21a9eff2-4bfe-4f81-a03e-0752c487f5e8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:50.182397 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-21a9eff2-4bfe-4f81-a03e-0752c487f5e8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.182397 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-21a9eff2-4bfe-4f81-a03e-0752c487f5e8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:50.414544 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-21a9eff2-4bfe-4f81-a03e-0752c487f5e8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:50.421662 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-21a9eff2-4bfe-4f81-a03e-0752c487f5e8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1319 microversion: 2.1 time: 0.259144 Nov 16 19:03:50.422503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 158/331] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:50 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:50.456870 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-aff593b8-573d-4d6e-a1f3-b50b0fb112b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:50.457921 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-aff593b8-573d-4d6e-a1f3-b50b0fb112b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:50.464983 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aff593b8-573d-4d6e-a1f3-b50b0fb112b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.465431 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aff593b8-573d-4d6e-a1f3-b50b0fb112b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:50.466240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aff593b8-573d-4d6e-a1f3-b50b0fb112b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.473258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aff593b8-573d-4d6e-a1f3-b50b0fb112b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:50.622739 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-aff593b8-573d-4d6e-a1f3-b50b0fb112b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:50.633507 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-aff593b8-573d-4d6e-a1f3-b50b0fb112b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.180171 Nov 16 19:03:50.634464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 174/332] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:50 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:50.647855 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-46ab8694-253e-40c9-aede-2573baf74087 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:50.648789 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-46ab8694-253e-40c9-aede-2573baf74087 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:50.655889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-46ab8694-253e-40c9-aede-2573baf74087 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.656942 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-46ab8694-253e-40c9-aede-2573baf74087 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:50.658199 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-46ab8694-253e-40c9-aede-2573baf74087 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.658836 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-46ab8694-253e-40c9-aede-2573baf74087 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:50.670908 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-938d403c-aaf6-4f7c-b8e9-0dc331f148d4 req-493958a1-231d-45f1-8d99-9d843376c94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4b93c2-1aa0-4417-bf2a-f3d581ae658e", "tag": "c0944e2a-6a82-4783-8c2e-ac416340d13d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:50.675869 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:03:50.675869 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:03:50.708827 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-938d403c-aaf6-4f7c-b8e9-0dc331f148d4 req-493958a1-231d-45f1-8d99-9d843376c94d service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.709296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-938d403c-aaf6-4f7c-b8e9-0dc331f148d4 req-493958a1-231d-45f1-8d99-9d843376c94d service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:50.721950 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-938d403c-aaf6-4f7c-b8e9-0dc331f148d4 req-493958a1-231d-45f1-8d99-9d843376c94d service nova] Creating event network-changed:c0944e2a-6a82-4783-8c2e-ac416340d13d for instance 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e on hv-cinder-66710 Nov 16 19:03:50.729602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-938d403c-aaf6-4f7c-b8e9-0dc331f148d4 req-493958a1-231d-45f1-8d99-9d843376c94d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062808 Nov 16 19:03:50.730607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 175/333] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:03:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:50.927364 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-46ab8694-253e-40c9-aede-2573baf74087 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:50.935647 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-46ab8694-253e-40c9-aede-2573baf74087 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.291426 Nov 16 19:03:50.936204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 159/334] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:50 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:50.988011 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a9aa8295-018d-4817-a7b2-ef1c16428668 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:50.989174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a9aa8295-018d-4817-a7b2-ef1c16428668 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:50.996397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a9aa8295-018d-4817-a7b2-ef1c16428668 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.996914 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a9aa8295-018d-4817-a7b2-ef1c16428668 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:50.997730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a9aa8295-018d-4817-a7b2-ef1c16428668 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:50.998161 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a9aa8295-018d-4817-a7b2-ef1c16428668 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:51.082512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a9aa8295-018d-4817-a7b2-ef1c16428668 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 32961 microversion: 2.20 time: 0.098574 Nov 16 19:03:51.083048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 176/335] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:50 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 32961 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:51.438926 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ba9c118a-a342-4c14-bf8a-717dec29532c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:51.439516 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ba9c118a-a342-4c14-bf8a-717dec29532c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:51.446241 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ba9c118a-a342-4c14-bf8a-717dec29532c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:51.447096 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ba9c118a-a342-4c14-bf8a-717dec29532c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:51.448084 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ba9c118a-a342-4c14-bf8a-717dec29532c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:51.448964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ba9c118a-a342-4c14-bf8a-717dec29532c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:51.650512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b396be61-3f3b-4ce3-ae44-481d6b914f73 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:51.651206 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b396be61-3f3b-4ce3-ae44-481d6b914f73 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:51.658608 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b396be61-3f3b-4ce3-ae44-481d6b914f73 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:51.660027 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b396be61-3f3b-4ce3-ae44-481d6b914f73 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:51.662040 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b396be61-3f3b-4ce3-ae44-481d6b914f73 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:51.662040 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b396be61-3f3b-4ce3-ae44-481d6b914f73 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:51.685970 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ba9c118a-a342-4c14-bf8a-717dec29532c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:51.693282 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ba9c118a-a342-4c14-bf8a-717dec29532c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1319 microversion: 2.1 time: 0.258312 Nov 16 19:03:51.694163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 160/336] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:51 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:51.809088 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b396be61-3f3b-4ce3-ae44-481d6b914f73 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:51.818356 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b396be61-3f3b-4ce3-ae44-481d6b914f73 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.171838 Nov 16 19:03:51.818930 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 177/337] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:51 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:51.952436 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-428848a4-6310-44f9-8436-8cde8059fc70 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:51.953058 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-428848a4-6310-44f9-8436-8cde8059fc70 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:51.958859 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-428848a4-6310-44f9-8436-8cde8059fc70 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:51.959610 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-428848a4-6310-44f9-8436-8cde8059fc70 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:51.960807 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-428848a4-6310-44f9-8436-8cde8059fc70 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:51.961432 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-428848a4-6310-44f9-8436-8cde8059fc70 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:52.095240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b1d2ffb8-e412-43ad-864f-5e59aa02ff88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:52.096615 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b1d2ffb8-e412-43ad-864f-5e59aa02ff88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:52.103792 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1d2ffb8-e412-43ad-864f-5e59aa02ff88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:52.104718 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1d2ffb8-e412-43ad-864f-5e59aa02ff88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:52.105590 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1d2ffb8-e412-43ad-864f-5e59aa02ff88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:52.106231 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1d2ffb8-e412-43ad-864f-5e59aa02ff88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:52.107455 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-428848a4-6310-44f9-8436-8cde8059fc70 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:52.116023 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-428848a4-6310-44f9-8436-8cde8059fc70 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.167137 Nov 16 19:03:52.117705 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 161/338] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:51 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:52.195319 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b1d2ffb8-e412-43ad-864f-5e59aa02ff88 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 33553 microversion: 2.20 time: 0.103873 Nov 16 19:03:52.195961 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 178/339] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:52 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 33553 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:52.710803 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-69eb429a-6ddb-4dbd-9132-f576e70aadd0 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:52.711387 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-69eb429a-6ddb-4dbd-9132-f576e70aadd0 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:52.718153 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-69eb429a-6ddb-4dbd-9132-f576e70aadd0 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:52.718592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-69eb429a-6ddb-4dbd-9132-f576e70aadd0 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:52.719503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-69eb429a-6ddb-4dbd-9132-f576e70aadd0 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:52.719958 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-69eb429a-6ddb-4dbd-9132-f576e70aadd0 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:52.836751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f5eba171-dc26-4de5-bb86-a6925cad32b2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:52.837667 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f5eba171-dc26-4de5-bb86-a6925cad32b2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:52.844335 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5eba171-dc26-4de5-bb86-a6925cad32b2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:52.844787 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5eba171-dc26-4de5-bb86-a6925cad32b2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:52.845575 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5eba171-dc26-4de5-bb86-a6925cad32b2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:52.846010 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5eba171-dc26-4de5-bb86-a6925cad32b2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:52.852015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-69eb429a-6ddb-4dbd-9132-f576e70aadd0 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:52.859463 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-69eb429a-6ddb-4dbd-9132-f576e70aadd0 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1319 microversion: 2.1 time: 0.152722 Nov 16 19:03:52.860099 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 162/340] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:52 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:52.979070 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f5eba171-dc26-4de5-bb86-a6925cad32b2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:52.987155 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f5eba171-dc26-4de5-bb86-a6925cad32b2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.154709 Nov 16 19:03:52.987704 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 179/341] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:52 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:53.134797 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6afd3729-c2ac-430c-b7cb-6e8a7109ec13 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:53.135388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6afd3729-c2ac-430c-b7cb-6e8a7109ec13 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:53.141175 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6afd3729-c2ac-430c-b7cb-6e8a7109ec13 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:53.141644 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6afd3729-c2ac-430c-b7cb-6e8a7109ec13 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:53.142401 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6afd3729-c2ac-430c-b7cb-6e8a7109ec13 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:53.142824 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6afd3729-c2ac-430c-b7cb-6e8a7109ec13 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:53.207810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f2d4a139-e37d-4365-a045-4ffc8abfd4e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:53.208725 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f2d4a139-e37d-4365-a045-4ffc8abfd4e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:53.215502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f2d4a139-e37d-4365-a045-4ffc8abfd4e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:53.215943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f2d4a139-e37d-4365-a045-4ffc8abfd4e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:53.216719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f2d4a139-e37d-4365-a045-4ffc8abfd4e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:53.217151 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f2d4a139-e37d-4365-a045-4ffc8abfd4e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:53.274913 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6afd3729-c2ac-430c-b7cb-6e8a7109ec13 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:53.282542 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6afd3729-c2ac-430c-b7cb-6e8a7109ec13 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.151678 Nov 16 19:03:53.283100 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 163/342] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:53 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:53.291180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f2d4a139-e37d-4365-a045-4ffc8abfd4e8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 34492 microversion: 2.20 time: 0.086936 Nov 16 19:03:53.292553 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 180/343] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:53 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 34492 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:53.876655 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5d148cc6-4f2f-4da5-b657-f944b891030b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:53.877254 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5d148cc6-4f2f-4da5-b657-f944b891030b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:53.884357 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5d148cc6-4f2f-4da5-b657-f944b891030b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:53.884804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5d148cc6-4f2f-4da5-b657-f944b891030b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:53.885609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5d148cc6-4f2f-4da5-b657-f944b891030b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:53.886096 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5d148cc6-4f2f-4da5-b657-f944b891030b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:54.004596 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-56aa7cbd-10ec-4d0b-8f3f-7ce7e951e6b9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:54.005429 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-56aa7cbd-10ec-4d0b-8f3f-7ce7e951e6b9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:54.013690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56aa7cbd-10ec-4d0b-8f3f-7ce7e951e6b9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:54.014230 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56aa7cbd-10ec-4d0b-8f3f-7ce7e951e6b9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:54.015072 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56aa7cbd-10ec-4d0b-8f3f-7ce7e951e6b9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:54.015569 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56aa7cbd-10ec-4d0b-8f3f-7ce7e951e6b9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:54.069699 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5d148cc6-4f2f-4da5-b657-f944b891030b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:54.086595 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5d148cc6-4f2f-4da5-b657-f944b891030b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1319 microversion: 2.1 time: 0.213438 Nov 16 19:03:54.087374 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 164/344] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:53 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:54.169350 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56aa7cbd-10ec-4d0b-8f3f-7ce7e951e6b9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:54.177965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-56aa7cbd-10ec-4d0b-8f3f-7ce7e951e6b9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.177398 Nov 16 19:03:54.178671 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 181/345] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:53 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:54.300200 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f68fa06e-c446-4c22-aaba-ca714b337472 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:54.301000 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f68fa06e-c446-4c22-aaba-ca714b337472 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:54.302349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0a4cd916-4ea4-400a-8e0d-6f882c4ed249 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:54.303296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0a4cd916-4ea4-400a-8e0d-6f882c4ed249 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:54.308005 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f68fa06e-c446-4c22-aaba-ca714b337472 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:54.308454 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f68fa06e-c446-4c22-aaba-ca714b337472 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:54.309240 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f68fa06e-c446-4c22-aaba-ca714b337472 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:54.309701 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f68fa06e-c446-4c22-aaba-ca714b337472 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:54.310374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a4cd916-4ea4-400a-8e0d-6f882c4ed249 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:54.310870 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a4cd916-4ea4-400a-8e0d-6f882c4ed249 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:54.311877 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a4cd916-4ea4-400a-8e0d-6f882c4ed249 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:54.312359 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a4cd916-4ea4-400a-8e0d-6f882c4ed249 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:54.394656 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0a4cd916-4ea4-400a-8e0d-6f882c4ed249 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 35468 microversion: 2.20 time: 0.095801 Nov 16 19:03:54.395300 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 182/346] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:54 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 35468 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:54.441479 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f68fa06e-c446-4c22-aaba-ca714b337472 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:54.449492 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f68fa06e-c446-4c22-aaba-ca714b337472 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.153177 Nov 16 19:03:54.450075 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 165/347] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:54 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:55.103849 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ab76953d-347b-43cc-8951-fc63d7aed8eb tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:55.104542 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ab76953d-347b-43cc-8951-fc63d7aed8eb tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:55.111379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ab76953d-347b-43cc-8951-fc63d7aed8eb tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:55.111824 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ab76953d-347b-43cc-8951-fc63d7aed8eb tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:55.112616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ab76953d-347b-43cc-8951-fc63d7aed8eb tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:55.113046 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ab76953d-347b-43cc-8951-fc63d7aed8eb tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:55.196495 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b610b715-8b46-4f5a-a3b5-aaa9b543e636 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:55.197122 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b610b715-8b46-4f5a-a3b5-aaa9b543e636 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:55.203355 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b610b715-8b46-4f5a-a3b5-aaa9b543e636 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:55.203798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b610b715-8b46-4f5a-a3b5-aaa9b543e636 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:55.204565 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b610b715-8b46-4f5a-a3b5-aaa9b543e636 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:55.204989 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b610b715-8b46-4f5a-a3b5-aaa9b543e636 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:55.249772 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ab76953d-347b-43cc-8951-fc63d7aed8eb tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:55.257448 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ab76953d-347b-43cc-8951-fc63d7aed8eb tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1319 microversion: 2.1 time: 0.157565 Nov 16 19:03:55.266947 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 183/348] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:55 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:55.340501 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b610b715-8b46-4f5a-a3b5-aaa9b543e636 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:55.348643 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b610b715-8b46-4f5a-a3b5-aaa9b543e636 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.156283 Nov 16 19:03:55.349795 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 166/349] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:55 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:55.406827 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9aea8629-f5fc-4141-bade-bed3897b692d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:55.407900 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9aea8629-f5fc-4141-bade-bed3897b692d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:55.414728 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9aea8629-f5fc-4141-bade-bed3897b692d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:55.415269 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9aea8629-f5fc-4141-bade-bed3897b692d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:55.416123 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9aea8629-f5fc-4141-bade-bed3897b692d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:55.416621 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9aea8629-f5fc-4141-bade-bed3897b692d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:55.466224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-91cb1b1a-9ffd-4d13-aa33-319ee76301cb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:55.466910 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-91cb1b1a-9ffd-4d13-aa33-319ee76301cb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:55.472540 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-91cb1b1a-9ffd-4d13-aa33-319ee76301cb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:55.472975 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-91cb1b1a-9ffd-4d13-aa33-319ee76301cb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:55.473763 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-91cb1b1a-9ffd-4d13-aa33-319ee76301cb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:55.474190 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-91cb1b1a-9ffd-4d13-aa33-319ee76301cb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:55.501563 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9aea8629-f5fc-4141-bade-bed3897b692d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 36697 microversion: 2.20 time: 0.098456 Nov 16 19:03:55.506345 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 184/350] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:55 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 36697 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:55.606253 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-91cb1b1a-9ffd-4d13-aa33-319ee76301cb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:55.613950 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-91cb1b1a-9ffd-4d13-aa33-319ee76301cb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.151271 Nov 16 19:03:55.614433 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 167/351] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:55 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:56.274927 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-21aa4df1-d7c0-488a-8044-c659b8763d78 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:56.275617 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-21aa4df1-d7c0-488a-8044-c659b8763d78 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:56.282533 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21aa4df1-d7c0-488a-8044-c659b8763d78 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:56.282979 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21aa4df1-d7c0-488a-8044-c659b8763d78 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:56.283748 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21aa4df1-d7c0-488a-8044-c659b8763d78 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:56.284179 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21aa4df1-d7c0-488a-8044-c659b8763d78 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:56.365510 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c9cc571e-cd89-474f-8b2f-4b29ff133ace tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:56.366138 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c9cc571e-cd89-474f-8b2f-4b29ff133ace tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:56.373337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9cc571e-cd89-474f-8b2f-4b29ff133ace tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:56.373817 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9cc571e-cd89-474f-8b2f-4b29ff133ace tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:56.374626 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9cc571e-cd89-474f-8b2f-4b29ff133ace tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:56.375311 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9cc571e-cd89-474f-8b2f-4b29ff133ace tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:56.421511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-21aa4df1-d7c0-488a-8044-c659b8763d78 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:56.428905 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-21aa4df1-d7c0-488a-8044-c659b8763d78 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1319 microversion: 2.1 time: 0.157874 Nov 16 19:03:56.429365 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 185/352] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:56 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:56.509662 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c9cc571e-cd89-474f-8b2f-4b29ff133ace tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:56.514255 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-80c27ada-532f-4582-b7bb-83d751d09b51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:56.515332 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-80c27ada-532f-4582-b7bb-83d751d09b51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:56.517478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c9cc571e-cd89-474f-8b2f-4b29ff133ace tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.155622 Nov 16 19:03:56.518062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 168/353] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:56 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:56.521035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-80c27ada-532f-4582-b7bb-83d751d09b51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:56.521480 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-80c27ada-532f-4582-b7bb-83d751d09b51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:56.522286 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-80c27ada-532f-4582-b7bb-83d751d09b51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:56.522718 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-80c27ada-532f-4582-b7bb-83d751d09b51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:56.596038 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-80c27ada-532f-4582-b7bb-83d751d09b51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 37875 microversion: 2.20 time: 0.085299 Nov 16 19:03:56.596684 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 186/354] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:56 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 37875 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:03:56.631281 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-18e4faa3-4db0-47af-a0d1-fbe7822ee5bb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:56.631908 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-18e4faa3-4db0-47af-a0d1-fbe7822ee5bb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:56.638716 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-18e4faa3-4db0-47af-a0d1-fbe7822ee5bb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:56.638920 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-18e4faa3-4db0-47af-a0d1-fbe7822ee5bb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:56.639570 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-18e4faa3-4db0-47af-a0d1-fbe7822ee5bb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:56.639999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-18e4faa3-4db0-47af-a0d1-fbe7822ee5bb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:56.772792 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-18e4faa3-4db0-47af-a0d1-fbe7822ee5bb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:56.780970 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-18e4faa3-4db0-47af-a0d1-fbe7822ee5bb tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.153438 Nov 16 19:03:56.781529 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 169/355] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:56 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:57.402079 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-2e133291-c655-4d92-be2b-8702b739ad2a req-59dc600a-6396-4893-9604-02cd4d915d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b93c2-1aa0-4417-bf2a-f3d581ae658e", "name": "network-vif-plugged", "status": "completed", "tag": "c0944e2a-6a82-4783-8c2e-ac416340d13d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:57.403583 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:03:57.403583 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:03:57.412499 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-2e133291-c655-4d92-be2b-8702b739ad2a req-59dc600a-6396-4893-9604-02cd4d915d97 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.412960 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-2e133291-c655-4d92-be2b-8702b739ad2a req-59dc600a-6396-4893-9604-02cd4d915d97 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.425103 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-2e133291-c655-4d92-be2b-8702b739ad2a req-59dc600a-6396-4893-9604-02cd4d915d97 service nova] Creating event network-vif-plugged:c0944e2a-6a82-4783-8c2e-ac416340d13d for instance 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e on hv-cinder-66710 Nov 16 19:03:57.429669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-2e133291-c655-4d92-be2b-8702b739ad2a req-59dc600a-6396-4893-9604-02cd4d915d97 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032454 Nov 16 19:03:57.430269 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 187/356] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:03:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:03:57.446463 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a4b6ab5e-4408-4621-bec8-f23747c57edc tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:57.447292 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a4b6ab5e-4408-4621-bec8-f23747c57edc tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:57.453647 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a4b6ab5e-4408-4621-bec8-f23747c57edc tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.454112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a4b6ab5e-4408-4621-bec8-f23747c57edc tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.454881 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a4b6ab5e-4408-4621-bec8-f23747c57edc tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.455308 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a4b6ab5e-4408-4621-bec8-f23747c57edc tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.535928 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-70a1c9da-dc90-445d-bad6-06688fabaaff tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:57.536656 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-70a1c9da-dc90-445d-bad6-06688fabaaff tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:57.543187 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-70a1c9da-dc90-445d-bad6-06688fabaaff tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.543626 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-70a1c9da-dc90-445d-bad6-06688fabaaff tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.544406 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-70a1c9da-dc90-445d-bad6-06688fabaaff tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.544841 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-70a1c9da-dc90-445d-bad6-06688fabaaff tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.613885 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a4b6ab5e-4408-4621-bec8-f23747c57edc tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:57.622580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a4b6ab5e-4408-4621-bec8-f23747c57edc tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1319 microversion: 2.1 time: 0.180283 Nov 16 19:03:57.631995 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 170/357] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:57 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:57.631995 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-28420d53-4982-4c7a-9574-a87d8ac05d59 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:57.631995 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-28420d53-4982-4c7a-9574-a87d8ac05d59 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:57.636985 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-28420d53-4982-4c7a-9574-a87d8ac05d59 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.637439 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-28420d53-4982-4c7a-9574-a87d8ac05d59 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.638329 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-28420d53-4982-4c7a-9574-a87d8ac05d59 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.638768 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-28420d53-4982-4c7a-9574-a87d8ac05d59 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.683286 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-70a1c9da-dc90-445d-bad6-06688fabaaff tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:57.691963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-70a1c9da-dc90-445d-bad6-06688fabaaff tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.160694 Nov 16 19:03:57.692556 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 188/358] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:57 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:57.797328 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-20ea1931-bbea-4dca-8aa9-153d106535f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:57.797947 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-20ea1931-bbea-4dca-8aa9-153d106535f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:57.804156 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-20ea1931-bbea-4dca-8aa9-153d106535f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.804596 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-20ea1931-bbea-4dca-8aa9-153d106535f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.806250 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-20ea1931-bbea-4dca-8aa9-153d106535f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:57.807006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-20ea1931-bbea-4dca-8aa9-153d106535f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:57.924592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-28420d53-4982-4c7a-9574-a87d8ac05d59 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 38168 microversion: 2.20 time: 0.300184 Nov 16 19:03:57.928914 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 171/359] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:57 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 38168 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:57.947553 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-20ea1931-bbea-4dca-8aa9-153d106535f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:57.955261 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-20ea1931-bbea-4dca-8aa9-153d106535f7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.161654 Nov 16 19:03:57.955810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 189/360] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:57 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:58.640070 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1e178d4b-4800-433f-9bfd-e5def6792c52 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:58.640751 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1e178d4b-4800-433f-9bfd-e5def6792c52 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:58.647710 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1e178d4b-4800-433f-9bfd-e5def6792c52 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:58.648152 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1e178d4b-4800-433f-9bfd-e5def6792c52 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:58.649432 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1e178d4b-4800-433f-9bfd-e5def6792c52 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:58.649890 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1e178d4b-4800-433f-9bfd-e5def6792c52 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:58.709965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-91e57c35-f7cf-4d3c-854a-e31502b53929 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:58.711669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-91e57c35-f7cf-4d3c-854a-e31502b53929 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:58.718107 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91e57c35-f7cf-4d3c-854a-e31502b53929 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:58.718732 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91e57c35-f7cf-4d3c-854a-e31502b53929 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:58.719462 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91e57c35-f7cf-4d3c-854a-e31502b53929 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:58.719898 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91e57c35-f7cf-4d3c-854a-e31502b53929 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:58.785446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1e178d4b-4800-433f-9bfd-e5def6792c52 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:58.792724 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1e178d4b-4800-433f-9bfd-e5def6792c52 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1319 microversion: 2.1 time: 0.156685 Nov 16 19:03:58.793500 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 172/361] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:58 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:58.855568 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-91e57c35-f7cf-4d3c-854a-e31502b53929 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:58.863513 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-91e57c35-f7cf-4d3c-854a-e31502b53929 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.157233 Nov 16 19:03:58.864073 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 190/362] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:58 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:03:58.937160 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d8ad2489-d2ca-41bb-bb8d-8192e734349a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:03:58.938074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d8ad2489-d2ca-41bb-bb8d-8192e734349a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:58.944313 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d8ad2489-d2ca-41bb-bb8d-8192e734349a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:58.944757 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d8ad2489-d2ca-41bb-bb8d-8192e734349a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:58.946062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d8ad2489-d2ca-41bb-bb8d-8192e734349a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:58.946493 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d8ad2489-d2ca-41bb-bb8d-8192e734349a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:58.972126 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-06653f7b-a716-4328-8aed-30d7d6f605d8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:58.972735 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-06653f7b-a716-4328-8aed-30d7d6f605d8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:58.978979 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-06653f7b-a716-4328-8aed-30d7d6f605d8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:58.979877 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-06653f7b-a716-4328-8aed-30d7d6f605d8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:58.980681 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-06653f7b-a716-4328-8aed-30d7d6f605d8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:58.981133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-06653f7b-a716-4328-8aed-30d7d6f605d8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:59.024713 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d8ad2489-d2ca-41bb-bb8d-8192e734349a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 38168 microversion: 2.20 time: 0.091366 Nov 16 19:03:59.026513 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 173/363] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:03:58 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 38168 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:03:59.118126 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-06653f7b-a716-4328-8aed-30d7d6f605d8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:59.126142 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-06653f7b-a716-4328-8aed-30d7d6f605d8 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.157644 Nov 16 19:03:59.126585 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 191/364] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:58 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:03:59.810301 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4143a5c4-4419-45da-abc0-7cbc46c26312 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:59.810987 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4143a5c4-4419-45da-abc0-7cbc46c26312 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:59.817808 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4143a5c4-4419-45da-abc0-7cbc46c26312 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:59.818301 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4143a5c4-4419-45da-abc0-7cbc46c26312 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:59.819597 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4143a5c4-4419-45da-abc0-7cbc46c26312 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:59.820323 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4143a5c4-4419-45da-abc0-7cbc46c26312 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:59.879954 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-092b48ab-216b-404e-bf31-fa7e1baa62d1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:03:59.880647 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-092b48ab-216b-404e-bf31-fa7e1baa62d1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:03:59.887750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-092b48ab-216b-404e-bf31-fa7e1baa62d1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:59.888297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-092b48ab-216b-404e-bf31-fa7e1baa62d1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:59.889147 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-092b48ab-216b-404e-bf31-fa7e1baa62d1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:03:59.889601 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-092b48ab-216b-404e-bf31-fa7e1baa62d1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:03:59.955682 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4143a5c4-4419-45da-abc0-7cbc46c26312 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:03:59.968887 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4143a5c4-4419-45da-abc0-7cbc46c26312 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1508 microversion: 2.1 time: 0.162313 Nov 16 19:03:59.969930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 174/365] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:59 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:00.027845 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-092b48ab-216b-404e-bf31-fa7e1baa62d1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:00.036144 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e69a907c-66b5-4854-b2d7-6567a6589745 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:00.036764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-092b48ab-216b-404e-bf31-fa7e1baa62d1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.160389 Nov 16 19:04:00.037091 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e69a907c-66b5-4854-b2d7-6567a6589745 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:00.037932 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 192/366] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:03:59 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:04:00.043775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e69a907c-66b5-4854-b2d7-6567a6589745 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:00.044219 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e69a907c-66b5-4854-b2d7-6567a6589745 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:00.044994 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e69a907c-66b5-4854-b2d7-6567a6589745 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:00.045425 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e69a907c-66b5-4854-b2d7-6567a6589745 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:00.123591 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e69a907c-66b5-4854-b2d7-6567a6589745 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 38188 microversion: 2.20 time: 0.091061 Nov 16 19:04:00.127752 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 175/367] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:04:00 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 38188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:04:00.143676 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-66977a1b-7730-4236-b97d-62b4a9fe0245 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:00.144306 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-66977a1b-7730-4236-b97d-62b4a9fe0245 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:00.150051 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-66977a1b-7730-4236-b97d-62b4a9fe0245 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:00.150497 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-66977a1b-7730-4236-b97d-62b4a9fe0245 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:00.151258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-66977a1b-7730-4236-b97d-62b4a9fe0245 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:00.151687 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-66977a1b-7730-4236-b97d-62b4a9fe0245 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:00.287810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-66977a1b-7730-4236-b97d-62b4a9fe0245 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:00.296374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-66977a1b-7730-4236-b97d-62b4a9fe0245 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.156151 Nov 16 19:04:00.296932 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 193/368] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:00 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:01.055636 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1edb0d5e-1522-4e87-a937-06dcfcf7b1de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:01.056314 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1edb0d5e-1522-4e87-a937-06dcfcf7b1de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:01.063092 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1edb0d5e-1522-4e87-a937-06dcfcf7b1de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:01.063642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1edb0d5e-1522-4e87-a937-06dcfcf7b1de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:01.064717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1edb0d5e-1522-4e87-a937-06dcfcf7b1de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:01.065316 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1edb0d5e-1522-4e87-a937-06dcfcf7b1de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:01.135666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0f763fc9-e102-4689-9d86-8f89eb6b2c0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:01.136629 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0f763fc9-e102-4689-9d86-8f89eb6b2c0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:01.143204 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0f763fc9-e102-4689-9d86-8f89eb6b2c0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:01.143840 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0f763fc9-e102-4689-9d86-8f89eb6b2c0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:01.144854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0f763fc9-e102-4689-9d86-8f89eb6b2c0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:01.145510 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0f763fc9-e102-4689-9d86-8f89eb6b2c0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:01.219461 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0f763fc9-e102-4689-9d86-8f89eb6b2c0f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 200 len: 38309 microversion: 2.20 time: 0.087594 Nov 16 19:04:01.220349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 194/369] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:04:01 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 38309 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:04:01.232291 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-37b627c8-6b5b-4efd-baca-6a303d1e1682 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:01.232869 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-37b627c8-6b5b-4efd-baca-6a303d1e1682 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:01.241128 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-37b627c8-6b5b-4efd-baca-6a303d1e1682 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:01.241693 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-37b627c8-6b5b-4efd-baca-6a303d1e1682 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:01.243418 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-37b627c8-6b5b-4efd-baca-6a303d1e1682 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:01.243860 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-37b627c8-6b5b-4efd-baca-6a303d1e1682 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:01.269521 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-37b627c8-6b5b-4efd-baca-6a303d1e1682 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/ips" status: 200 len: 150 microversion: 2.20 time: 0.041542 Nov 16 19:04:01.270309 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 195/370] 10.222.0.46 () {60 vars in 1288 bytes} [Tue Nov 16 19:04:01 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:04:01.314382 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a9e2155f-8d93-4198-92d2-56c019c83ecd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:01.314990 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a9e2155f-8d93-4198-92d2-56c019c83ecd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:01.321739 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a9e2155f-8d93-4198-92d2-56c019c83ecd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:01.322504 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a9e2155f-8d93-4198-92d2-56c019c83ecd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:01.323311 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a9e2155f-8d93-4198-92d2-56c019c83ecd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:01.323747 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a9e2155f-8d93-4198-92d2-56c019c83ecd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:01.421930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1edb0d5e-1522-4e87-a937-06dcfcf7b1de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:01.433822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1edb0d5e-1522-4e87-a937-06dcfcf7b1de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.382546 Nov 16 19:04:01.435098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 176/371] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:01 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:01.489391 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a9e2155f-8d93-4198-92d2-56c019c83ecd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:01.497999 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a9e2155f-8d93-4198-92d2-56c019c83ecd tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.187502 Nov 16 19:04:01.501611 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 196/372] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:01 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:04:02.452234 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0623d4d2-0b13-42fc-923c-bfabcbee1152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:02.452830 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0623d4d2-0b13-42fc-923c-bfabcbee1152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:02.459184 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0623d4d2-0b13-42fc-923c-bfabcbee1152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:02.459627 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0623d4d2-0b13-42fc-923c-bfabcbee1152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:02.460396 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0623d4d2-0b13-42fc-923c-bfabcbee1152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:02.460858 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0623d4d2-0b13-42fc-923c-bfabcbee1152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:02.515642 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f675c68a-381f-410f-b31c-d3e040d289de tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:02.516251 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f675c68a-381f-410f-b31c-d3e040d289de tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:02.522196 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f675c68a-381f-410f-b31c-d3e040d289de tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:02.522649 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f675c68a-381f-410f-b31c-d3e040d289de tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:02.523461 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f675c68a-381f-410f-b31c-d3e040d289de tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:02.523893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f675c68a-381f-410f-b31c-d3e040d289de tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:02.604413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0623d4d2-0b13-42fc-923c-bfabcbee1152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:02.612279 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0623d4d2-0b13-42fc-923c-bfabcbee1152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.163686 Nov 16 19:04:02.613034 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 177/373] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:02 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:02.659100 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f675c68a-381f-410f-b31c-d3e040d289de tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:02.668142 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f675c68a-381f-410f-b31c-d3e040d289de tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.156820 Nov 16 19:04:02.668816 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 197/374] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:02 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:03.514060 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-32951588-8944-49a0-ac91-7bed0e4ac2a0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:03.514660 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-32951588-8944-49a0-ac91-7bed0e4ac2a0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:03.521491 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-32951588-8944-49a0-ac91-7bed0e4ac2a0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:03.522092 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-32951588-8944-49a0-ac91-7bed0e4ac2a0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:03.523006 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-32951588-8944-49a0-ac91-7bed0e4ac2a0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:03.523511 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-32951588-8944-49a0-ac91-7bed0e4ac2a0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:03.547318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-32951588-8944-49a0-ac91-7bed0e4ac2a0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lazy-loading 'flavor' on Instance uuid b188c4dd-b4cc-4a02-9ea4-901009c68534 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:04:03.629354 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-04633f33-e8e0-4887-af79-7b0b7d182574 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:03.629998 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-04633f33-e8e0-4887-af79-7b0b7d182574 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:03.636504 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-04633f33-e8e0-4887-af79-7b0b7d182574 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:03.636946 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-04633f33-e8e0-4887-af79-7b0b7d182574 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:03.637774 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-04633f33-e8e0-4887-af79-7b0b7d182574 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:03.638207 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-04633f33-e8e0-4887-af79-7b0b7d182574 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:03.771974 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-04633f33-e8e0-4887-af79-7b0b7d182574 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:03.780920 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-04633f33-e8e0-4887-af79-7b0b7d182574 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1720 microversion: 2.1 time: 0.155023 Nov 16 19:04:03.781751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 198/375] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:03 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:04:03.786874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a1acf8fa-8343-468e-aebc-08452232ea6d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:03.787662 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a1acf8fa-8343-468e-aebc-08452232ea6d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:03.794845 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1acf8fa-8343-468e-aebc-08452232ea6d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:03.795329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1acf8fa-8343-468e-aebc-08452232ea6d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:03.796251 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1acf8fa-8343-468e-aebc-08452232ea6d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:03.796685 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1acf8fa-8343-468e-aebc-08452232ea6d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:03.813098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-32951588-8944-49a0-ac91-7bed0e4ac2a0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 202 len: 0 microversion: 2.20 time: 0.302570 Nov 16 19:04:03.813920 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 178/376] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:04:03 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:04:03.823291 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:03.824688 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:03.834126 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:03.834612 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:03.835438 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:03.836395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:03.939747 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a1acf8fa-8343-468e-aebc-08452232ea6d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:03.947766 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a1acf8fa-8343-468e-aebc-08452232ea6d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1567 microversion: 2.1 time: 0.164443 Nov 16 19:04:03.948335 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 199/377] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:03 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:03.980854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:03.989894 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:03.991749 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:03.992967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4cd9d2ec-9629-4793-b72c-8b91736de5ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.174104 Nov 16 19:04:03.993521 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 179/378] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:03 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:04.799091 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4ee49f51-d049-4c9f-be1b-1b8407beae98 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:04.799720 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4ee49f51-d049-4c9f-be1b-1b8407beae98 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:04.806047 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4ee49f51-d049-4c9f-be1b-1b8407beae98 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:04.806490 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4ee49f51-d049-4c9f-be1b-1b8407beae98 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:04.807252 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4ee49f51-d049-4c9f-be1b-1b8407beae98 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:04.807682 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4ee49f51-d049-4c9f-be1b-1b8407beae98 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:04.939186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4ee49f51-d049-4c9f-be1b-1b8407beae98 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:04.947388 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4ee49f51-d049-4c9f-be1b-1b8407beae98 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1697 microversion: 2.1 time: 0.151969 Nov 16 19:04:04.947934 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 200/379] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:04 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:04.964000 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c579a3ef-9f6c-4175-a701-ebf03a977cb7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:04.965458 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e2cb6122-aac9-4c74-a5c1-486d27ffa812 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:04.966082 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e2cb6122-aac9-4c74-a5c1-486d27ffa812 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:04.970254 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c579a3ef-9f6c-4175-a701-ebf03a977cb7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:04.970694 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c579a3ef-9f6c-4175-a701-ebf03a977cb7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:04.971619 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2cb6122-aac9-4c74-a5c1-486d27ffa812 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:04.972060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2cb6122-aac9-4c74-a5c1-486d27ffa812 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:04.972828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2cb6122-aac9-4c74-a5c1-486d27ffa812 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:04.973254 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2cb6122-aac9-4c74-a5c1-486d27ffa812 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.033399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c579a3ef-9f6c-4175-a701-ebf03a977cb7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Going to try to start instance {{(pid=116169) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 16 19:04:05.077403 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c579a3ef-9f6c-4175-a701-ebf03a977cb7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 202 len: 0 microversion: 2.1 time: 0.117414 Nov 16 19:04:05.081716 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 180/380] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:04:04 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:04:05.087665 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:05.088371 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:05.094937 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.095391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.096198 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.096634 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.123125 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e2cb6122-aac9-4c74-a5c1-486d27ffa812 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:05.132503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e2cb6122-aac9-4c74-a5c1-486d27ffa812 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1547 microversion: 2.1 time: 0.170906 Nov 16 19:04:05.140531 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 201/381] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:04 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:04:05.145528 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-661e94c7-0071-4232-98c4-fe292041c832 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:05.146168 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-661e94c7-0071-4232-98c4-fe292041c832 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:05.152981 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-661e94c7-0071-4232-98c4-fe292041c832 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.153434 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-661e94c7-0071-4232-98c4-fe292041c832 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.154258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-661e94c7-0071-4232-98c4-fe292041c832 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.154687 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-661e94c7-0071-4232-98c4-fe292041c832 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.268368 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:05.277438 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:05.279466 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:05.280842 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e58631d5-6ea9-41d3-ab9b-d2d12dcaf1db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.198073 Nov 16 19:04:05.281403 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 181/382] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:05 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:05.287204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:05.287874 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:05.293509 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-661e94c7-0071-4232-98c4-fe292041c832 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:05.295107 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.295556 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.296338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.296767 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.311699 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-661e94c7-0071-4232-98c4-fe292041c832 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1706 microversion: 2.1 time: 0.160386 Nov 16 19:04:05.311699 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 202/383] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:05 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1706 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:05.424528 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] HTTP exception thrown: Cannot 'detach_volume' instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 while it is in vm_state rescued Nov 16 19:04:05.425902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Returning 409 to user: Cannot 'detach_volume' instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 while it is in vm_state rescued {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:04:05.426779 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-50adc4ed-0c96-46c0-a9da-1cd9588da040 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments/43f621e6-f073-4390-b2ee-86e728e37de1" status: 409 len: 152 microversion: 2.1 time: 0.144157 Nov 16 19:04:05.427677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 182/384] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:04:05 2021] DELETE /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments/43f621e6-f073-4390-b2ee-86e728e37de1 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 16 19:04:05.437366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7aeb7589-5438-45f1-be1f-9bb5e12beb5f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:05.438047 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7aeb7589-5438-45f1-be1f-9bb5e12beb5f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:05.443834 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7aeb7589-5438-45f1-be1f-9bb5e12beb5f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.444357 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7aeb7589-5438-45f1-be1f-9bb5e12beb5f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.445209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7aeb7589-5438-45f1-be1f-9bb5e12beb5f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.445806 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7aeb7589-5438-45f1-be1f-9bb5e12beb5f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.511555 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7aeb7589-5438-45f1-be1f-9bb5e12beb5f tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/action" status: 202 len: 0 microversion: 2.1 time: 0.078791 Nov 16 19:04:05.512408 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 203/385] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:04:05 2021] POST /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:04:05.520588 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bbd82610-a035-4df7-95cd-358ca67a42d7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:05.521432 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bbd82610-a035-4df7-95cd-358ca67a42d7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:05.529369 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbd82610-a035-4df7-95cd-358ca67a42d7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.529849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbd82610-a035-4df7-95cd-358ca67a42d7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.530642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbd82610-a035-4df7-95cd-358ca67a42d7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:05.531262 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbd82610-a035-4df7-95cd-358ca67a42d7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:05.855178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bbd82610-a035-4df7-95cd-358ca67a42d7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:05.863224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bbd82610-a035-4df7-95cd-358ca67a42d7 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1555 microversion: 2.1 time: 0.346317 Nov 16 19:04:05.863796 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 183/386] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:05 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1555 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:06.307557 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:06.308627 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:06.314875 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:06.315320 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:06.316106 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:06.316541 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:06.323610 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-76ad1d0b-f4e0-480d-b053-917751edb785 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:06.324231 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-76ad1d0b-f4e0-480d-b053-917751edb785 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:06.330519 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-76ad1d0b-f4e0-480d-b053-917751edb785 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:06.330959 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-76ad1d0b-f4e0-480d-b053-917751edb785 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:06.331726 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-76ad1d0b-f4e0-480d-b053-917751edb785 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:06.332148 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-76ad1d0b-f4e0-480d-b053-917751edb785 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:06.453537 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:06.461875 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:06.463426 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:06.464604 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-093e9175-77b9-4877-8f09-93dd17fa4c72 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.167074 Nov 16 19:04:06.467172 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 204/387] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:06 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:06.467542 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-76ad1d0b-f4e0-480d-b053-917751edb785 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:06.475504 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-76ad1d0b-f4e0-480d-b053-917751edb785 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1706 microversion: 2.1 time: 0.155638 Nov 16 19:04:06.476047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 184/388] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:06 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1706 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:04:06.881421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5ed9be00-d7c2-43d1-83c1-b1480fe0cdd6 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:06.882049 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5ed9be00-d7c2-43d1-83c1-b1480fe0cdd6 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:06.889162 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ed9be00-d7c2-43d1-83c1-b1480fe0cdd6 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:06.889630 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ed9be00-d7c2-43d1-83c1-b1480fe0cdd6 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:06.890408 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ed9be00-d7c2-43d1-83c1-b1480fe0cdd6 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:06.890840 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ed9be00-d7c2-43d1-83c1-b1480fe0cdd6 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:07.023368 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5ed9be00-d7c2-43d1-83c1-b1480fe0cdd6 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:07.031692 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5ed9be00-d7c2-43d1-83c1-b1480fe0cdd6 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1555 microversion: 2.1 time: 0.154018 Nov 16 19:04:07.032251 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 205/389] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:06 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:07.483457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:07.484062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:07.490442 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:07.490890 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:07.491664 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:07.492111 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:07.493108 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-034f061e-0cbd-492a-b6ec-7e613b3018c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:07.493745 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-034f061e-0cbd-492a-b6ec-7e613b3018c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:07.499982 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-034f061e-0cbd-492a-b6ec-7e613b3018c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:07.500425 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-034f061e-0cbd-492a-b6ec-7e613b3018c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:07.501199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-034f061e-0cbd-492a-b6ec-7e613b3018c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:07.501657 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-034f061e-0cbd-492a-b6ec-7e613b3018c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:07.634185 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:07.636459 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-034f061e-0cbd-492a-b6ec-7e613b3018c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:07.642261 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:07.643765 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:07.644427 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-034f061e-0cbd-492a-b6ec-7e613b3018c6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1710 microversion: 2.1 time: 0.154869 Nov 16 19:04:07.644916 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2742ef5b-67e5-4ba5-84d8-7170de542dbf tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.165179 Nov 16 19:04:07.645030 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 206/390] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:07 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:04:07.645564 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 185/391] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:07 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:08.048929 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6a131958-9ab9-4f32-ba03-1610a8c04497 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:08.049444 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6a131958-9ab9-4f32-ba03-1610a8c04497 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:08.055455 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a131958-9ab9-4f32-ba03-1610a8c04497 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:08.055902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a131958-9ab9-4f32-ba03-1610a8c04497 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:08.056674 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a131958-9ab9-4f32-ba03-1610a8c04497 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:08.057109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a131958-9ab9-4f32-ba03-1610a8c04497 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:08.190288 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6a131958-9ab9-4f32-ba03-1610a8c04497 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:08.198914 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6a131958-9ab9-4f32-ba03-1610a8c04497 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1555 microversion: 2.1 time: 0.153707 Nov 16 19:04:08.199478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 207/392] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:08 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:08.663630 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:08.664227 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:08.670996 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:08.671434 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:08.672259 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:08.672610 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:08.811476 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:08.819123 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:08.821112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:08.822354 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-aa09a150-999e-4264-b73b-3a5f87139f46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.162481 Nov 16 19:04:08.822910 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 186/393] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:08 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:09.216471 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-aaec3a44-f1f8-4310-b384-6cf74aa2e913 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:09.217083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-aaec3a44-f1f8-4310-b384-6cf74aa2e913 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:09.223642 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aaec3a44-f1f8-4310-b384-6cf74aa2e913 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:09.224228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aaec3a44-f1f8-4310-b384-6cf74aa2e913 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:09.224951 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aaec3a44-f1f8-4310-b384-6cf74aa2e913 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:09.225387 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aaec3a44-f1f8-4310-b384-6cf74aa2e913 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:09.365065 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-aaec3a44-f1f8-4310-b384-6cf74aa2e913 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:09.372824 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-aaec3a44-f1f8-4310-b384-6cf74aa2e913 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1561 microversion: 2.1 time: 0.160221 Nov 16 19:04:09.373376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 208/394] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:09 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:09.440001 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d275054c-d016-43dc-a98a-5fb3fb8c2cf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:09.440482 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d275054c-d016-43dc-a98a-5fb3fb8c2cf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:09.446832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d275054c-d016-43dc-a98a-5fb3fb8c2cf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:09.447327 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d275054c-d016-43dc-a98a-5fb3fb8c2cf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:09.448086 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d275054c-d016-43dc-a98a-5fb3fb8c2cf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:09.448510 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d275054c-d016-43dc-a98a-5fb3fb8c2cf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:09.528636 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-d275054c-d016-43dc-a98a-5fb3fb8c2cf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lazy-loading 'services' on Instance uuid c22ea69e-6ab3-4ba5-b12b-f940430d6649 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:04:09.640644 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d275054c-d016-43dc-a98a-5fb3fb8c2cf9 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments/43f621e6-f073-4390-b2ee-86e728e37de1" status: 202 len: 0 microversion: 2.1 time: 0.204094 Nov 16 19:04:09.641431 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 187/395] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:04:09 2021] DELETE /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments/43f621e6-f073-4390-b2ee-86e728e37de1 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:04:09.649508 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2751ebbc-6ca1-4196-ab90-579fa8991513 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:09.650525 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2751ebbc-6ca1-4196-ab90-579fa8991513 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:09.656205 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2751ebbc-6ca1-4196-ab90-579fa8991513 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:09.656728 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2751ebbc-6ca1-4196-ab90-579fa8991513 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:09.657503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2751ebbc-6ca1-4196-ab90-579fa8991513 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:09.657968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2751ebbc-6ca1-4196-ab90-579fa8991513 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:09.690159 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2751ebbc-6ca1-4196-ab90-579fa8991513 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044303 Nov 16 19:04:09.691809 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 209/396] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:04:09 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:09.841852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:09.842535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:09.851170 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:09.851617 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:09.853000 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:09.853463 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:09.987333 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:09.995302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:09.996794 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:09.997970 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-65f3c8d5-7f6a-405f-a30b-c2f4c509f615 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.160378 Nov 16 19:04:09.998531 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 188/397] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:09 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:10.702298 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e55c3cab-10dd-4b26-bc65-ee8e283f0e17 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:10.703234 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e55c3cab-10dd-4b26-bc65-ee8e283f0e17 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:10.709442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e55c3cab-10dd-4b26-bc65-ee8e283f0e17 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:10.709920 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e55c3cab-10dd-4b26-bc65-ee8e283f0e17 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:10.710689 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e55c3cab-10dd-4b26-bc65-ee8e283f0e17 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:10.711122 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e55c3cab-10dd-4b26-bc65-ee8e283f0e17 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:10.741196 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e55c3cab-10dd-4b26-bc65-ee8e283f0e17 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042600 Nov 16 19:04:10.741784 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 210/398] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:04:10 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:04:11.019622 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:11.020232 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:11.027093 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:11.027532 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:11.028458 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:11.028908 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:11.162919 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:11.171693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:11.173183 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:11.174429 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-47509723-c552-44ce-a5a8-6a8f9a5ea747 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.159292 Nov 16 19:04:11.174980 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 189/399] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:11 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:12.194485 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:12.195004 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:12.201885 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:12.202340 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:12.203107 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:12.203557 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:12.342703 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:12.351162 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:12.352665 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:12.353879 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4124a39e-e9ba-4bfa-8839-26ccd56cd7dc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.163703 Nov 16 19:04:12.354432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 211/400] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:12 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:13.046112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cd3e92d2-bc69-4ee9-9e96-1c7ee63dff5e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:13.046694 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cd3e92d2-bc69-4ee9-9e96-1c7ee63dff5e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:13.053982 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cd3e92d2-bc69-4ee9-9e96-1c7ee63dff5e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:13.054426 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cd3e92d2-bc69-4ee9-9e96-1c7ee63dff5e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:13.055243 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cd3e92d2-bc69-4ee9-9e96-1c7ee63dff5e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:13.055677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cd3e92d2-bc69-4ee9-9e96-1c7ee63dff5e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:13.082789 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cd3e92d2-bc69-4ee9-9e96-1c7ee63dff5e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:04:13.161754 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cd3e92d2-bc69-4ee9-9e96-1c7ee63dff5e tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 204 len: 0 microversion: 2.1 time: 0.119139 Nov 16 19:04:13.165198 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 190/401] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:04:13 2021] DELETE /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:04:13.170366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-caca5a5c-5ede-4156-9a0c-a7e939ebc460 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:13.170972 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-caca5a5c-5ede-4156-9a0c-a7e939ebc460 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:13.176754 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-caca5a5c-5ede-4156-9a0c-a7e939ebc460 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:13.177205 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-caca5a5c-5ede-4156-9a0c-a7e939ebc460 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:13.178006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-caca5a5c-5ede-4156-9a0c-a7e939ebc460 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:13.178449 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-caca5a5c-5ede-4156-9a0c-a7e939ebc460 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:13.315210 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-caca5a5c-5ede-4156-9a0c-a7e939ebc460 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:13.322993 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-caca5a5c-5ede-4156-9a0c-a7e939ebc460 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1507 microversion: 2.1 time: 0.156493 Nov 16 19:04:13.323549 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 212/402] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:13 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:13.372412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:13.373167 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:13.379020 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:13.379469 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:13.380233 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:13.380664 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:13.513132 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:13.520937 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:13.522457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:13.523595 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a72591a4-f382-48e1-90fb-a2298314ccab tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.155289 Nov 16 19:04:13.524151 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 191/403] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:13 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:14.339445 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f46a1e8d-b5fd-408a-95d8-16a885908ae0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:14.339987 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f46a1e8d-b5fd-408a-95d8-16a885908ae0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:14.346396 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f46a1e8d-b5fd-408a-95d8-16a885908ae0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:14.346843 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f46a1e8d-b5fd-408a-95d8-16a885908ae0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:14.347644 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f46a1e8d-b5fd-408a-95d8-16a885908ae0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:14.348072 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f46a1e8d-b5fd-408a-95d8-16a885908ae0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:14.481326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f46a1e8d-b5fd-408a-95d8-16a885908ae0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:14.488543 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f46a1e8d-b5fd-408a-95d8-16a885908ae0 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1507 microversion: 2.1 time: 0.153401 Nov 16 19:04:14.489103 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 213/404] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:14 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:14.542412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:14.543030 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:14.549300 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:14.549782 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:14.550539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:14.550965 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:14.684200 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:14.693913 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:14.695853 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:14.697710 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7f783dda-2cba-4e98-b972-b0b9612808d5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.158371 Nov 16 19:04:14.698442 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 192/405] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:14 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:15.505191 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1d4e335a-ab78-47be-83f8-818271b0d2f3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:15.505817 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1d4e335a-ab78-47be-83f8-818271b0d2f3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:15.512257 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d4e335a-ab78-47be-83f8-818271b0d2f3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:15.512702 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d4e335a-ab78-47be-83f8-818271b0d2f3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:15.513463 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d4e335a-ab78-47be-83f8-818271b0d2f3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:15.513922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d4e335a-ab78-47be-83f8-818271b0d2f3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:15.641974 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1d4e335a-ab78-47be-83f8-818271b0d2f3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:15.649139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1d4e335a-ab78-47be-83f8-818271b0d2f3 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1507 microversion: 2.1 time: 0.147560 Nov 16 19:04:15.649723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 214/406] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:15 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:15.715635 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:15.716231 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:15.722469 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:15.722908 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:15.723674 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:15.724096 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:15.853368 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:15.861029 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:15.862537 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:15.863680 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-df817730-c355-4298-81da-8e75fa8cae7b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.151722 Nov 16 19:04:15.864234 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 193/407] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:15 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:16.460607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-8bd5fc99-5c18-4ea8-9fee-230c772957fc req-966291c6-f3d9-4ef5-935b-f7686f73cc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a582c36-f154-4050-a431-1eea01999490", "name": "network-vif-deleted", "tag": "57e6c1c0-bfcc-44c4-82b5-890dc4a034df"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:16.463466 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:04:16.463466 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:04:16.473389 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8bd5fc99-5c18-4ea8-9fee-230c772957fc req-966291c6-f3d9-4ef5-935b-f7686f73cc53 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:16.473856 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8bd5fc99-5c18-4ea8-9fee-230c772957fc req-966291c6-f3d9-4ef5-935b-f7686f73cc53 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:16.487038 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-8bd5fc99-5c18-4ea8-9fee-230c772957fc req-966291c6-f3d9-4ef5-935b-f7686f73cc53 service nova] Creating event network-vif-deleted:57e6c1c0-bfcc-44c4-82b5-890dc4a034df for instance 8a582c36-f154-4050-a431-1eea01999490 on hv-cinder-66710 Nov 16 19:04:16.493297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-8bd5fc99-5c18-4ea8-9fee-230c772957fc req-966291c6-f3d9-4ef5-935b-f7686f73cc53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036460 Nov 16 19:04:16.493962 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 215/408] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:04:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:04:16.666545 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:16.667139 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:16.672849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:16.673287 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:16.674081 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:16.674504 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:16.703977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:16.704402 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:16.704834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lazy-loading 'fault' on Instance uuid 8a582c36-f154-4050-a431-1eea01999490 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:04:16.742901 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:16.750779 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-24c4f330-a815-49a3-b888-91fcddde9c64 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 200 len: 1311 microversion: 2.1 time: 0.088422 Nov 16 19:04:16.751330 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 194/409] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:16 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 1311 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:16.882568 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:16.883531 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:16.890574 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:16.891030 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:16.891808 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:16.892248 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:17.025873 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:17.033680 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:17.035168 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:17.036589 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d6b6cc51-6aff-45a7-a44f-69c237c841c0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.158201 Nov 16 19:04:17.037158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 216/410] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:16 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:17.768079 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:17.768671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: 8a582c36-f154-4050-a431-1eea01999490] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:17.775304 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:17.775738 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:17.776494 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:17.776919 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:17.789679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] HTTP exception thrown: Instance 8a582c36-f154-4050-a431-1eea01999490 could not be found. Nov 16 19:04:17.790245 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Returning 404 to user: Instance 8a582c36-f154-4050-a431-1eea01999490 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:04:17.791546 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c9e10c7a-154c-4d83-8099-682165fe3942 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490" status: 404 len: 111 microversion: 2.1 time: 0.027185 Nov 16 19:04:17.792052 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 195/411] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:17 2021] GET /compute/v2.1/servers/8a582c36-f154-4050-a431-1eea01999490 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:04:17.800405 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6117163a-5f67-467e-8d1d-ce561af8abf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:17.800901 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6117163a-5f67-467e-8d1d-ce561af8abf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:17.807369 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6117163a-5f67-467e-8d1d-ce561af8abf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:17.807819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6117163a-5f67-467e-8d1d-ce561af8abf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:17.808594 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6117163a-5f67-467e-8d1d-ce561af8abf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:17.809028 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6117163a-5f67-467e-8d1d-ce561af8abf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:17.833492 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6117163a-5f67-467e-8d1d-ce561af8abf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:04:17.906888 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6117163a-5f67-467e-8d1d-ce561af8abf5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 204 len: 0 microversion: 2.1 time: 0.110057 Nov 16 19:04:17.907914 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 217/412] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:04:17 2021] DELETE /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:04:17.915689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-87da37e8-b1f1-4f8c-a946-7780f0f05659 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:17.916890 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-87da37e8-b1f1-4f8c-a946-7780f0f05659 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:17.922803 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-87da37e8-b1f1-4f8c-a946-7780f0f05659 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:17.923245 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-87da37e8-b1f1-4f8c-a946-7780f0f05659 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:17.924013 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-87da37e8-b1f1-4f8c-a946-7780f0f05659 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:17.924440 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-87da37e8-b1f1-4f8c-a946-7780f0f05659 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:18.055945 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-87da37e8-b1f1-4f8c-a946-7780f0f05659 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:18.056974 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:18.057717 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:18.063800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:18.063991 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-87da37e8-b1f1-4f8c-a946-7780f0f05659 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.151848 Nov 16 19:04:18.064249 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:18.064354 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 196/413] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:17 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:18.065085 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:18.065472 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:18.201741 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:18.209502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:18.211031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:18.212183 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9bc11f94-645d-40a7-822e-1981947a5833 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.159951 Nov 16 19:04:18.212741 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 218/414] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:18 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:19.081331 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6b102c97-66b2-4b85-9398-40d1293d8270 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:19.081968 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6b102c97-66b2-4b85-9398-40d1293d8270 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:19.089061 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b102c97-66b2-4b85-9398-40d1293d8270 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:19.089583 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b102c97-66b2-4b85-9398-40d1293d8270 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:19.090355 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b102c97-66b2-4b85-9398-40d1293d8270 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:19.090870 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b102c97-66b2-4b85-9398-40d1293d8270 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:19.222167 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6b102c97-66b2-4b85-9398-40d1293d8270 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:19.229863 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6b102c97-66b2-4b85-9398-40d1293d8270 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.152081 Nov 16 19:04:19.230581 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:19.231049 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 197/415] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:19 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:19.231148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:19.236815 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:19.237260 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:19.238060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:19.238487 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:19.280196 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2ca478e9-4b11-482c-8f00-4246c6b6829b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c27eb627-f628-4c19-86c6-664b6ec48cd1", "device": "/dev/sdb"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:19.282171 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2ca478e9-4b11-482c-8f00-4246c6b6829b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:19.287952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ca478e9-4b11-482c-8f00-4246c6b6829b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:19.288394 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ca478e9-4b11-482c-8f00-4246c6b6829b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:19.289164 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ca478e9-4b11-482c-8f00-4246c6b6829b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:19.289614 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ca478e9-4b11-482c-8f00-4246c6b6829b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:19.367729 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:19.376892 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:19.378568 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:19.379775 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4523bc3e-2d9b-4fd7-bf31-cf082ba90f45 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.153036 Nov 16 19:04:19.380679 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 219/416] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:19 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:19.546509 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2ca478e9-4b11-482c-8f00-4246c6b6829b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "POST /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269860 Nov 16 19:04:19.547135 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 198/417] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:04:19 2021] POST /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:04:20.246666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f5fc7bfa-1ddd-47eb-b3d8-c8ff6b1b0286 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:20.247421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f5fc7bfa-1ddd-47eb-b3d8-c8ff6b1b0286 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:20.253923 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5fc7bfa-1ddd-47eb-b3d8-c8ff6b1b0286 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:20.254376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5fc7bfa-1ddd-47eb-b3d8-c8ff6b1b0286 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:20.255148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5fc7bfa-1ddd-47eb-b3d8-c8ff6b1b0286 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:20.255584 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5fc7bfa-1ddd-47eb-b3d8-c8ff6b1b0286 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:20.390274 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f5fc7bfa-1ddd-47eb-b3d8-c8ff6b1b0286 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:20.397918 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f5fc7bfa-1ddd-47eb-b3d8-c8ff6b1b0286 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.154901 Nov 16 19:04:20.398491 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 220/418] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:20 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:20.401418 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:20.402148 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:20.408148 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:20.408624 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:20.409421 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:20.409879 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:20.536387 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:20.544095 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:20.545621 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:20.546774 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4efdf077-8253-44db-b2fb-09d39df5b2a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1742 microversion: 2.20 time: 0.150666 Nov 16 19:04:20.547326 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 199/419] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:20 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1742 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:21.416849 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5ef5fac8-d68d-420e-8542-5df797a9da9d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:21.417451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5ef5fac8-d68d-420e-8542-5df797a9da9d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:21.423660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ef5fac8-d68d-420e-8542-5df797a9da9d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:21.424140 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ef5fac8-d68d-420e-8542-5df797a9da9d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:21.424930 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ef5fac8-d68d-420e-8542-5df797a9da9d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:21.425365 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ef5fac8-d68d-420e-8542-5df797a9da9d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:21.553695 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5ef5fac8-d68d-420e-8542-5df797a9da9d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:21.561883 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5ef5fac8-d68d-420e-8542-5df797a9da9d tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.149581 Nov 16 19:04:21.562450 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 221/420] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:21 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:21.565518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:21.566537 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:21.573627 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:21.574169 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:21.574948 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:21.575384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:21.712852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:21.720526 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:21.722059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:21.723207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0bf93395-5489-4015-9095-927f2cd99661 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1742 microversion: 2.20 time: 0.161697 Nov 16 19:04:21.723760 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 200/421] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:21 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:22.578753 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bdd42218-08b9-45f5-bae9-3b5da5d18b06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:22.579432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bdd42218-08b9-45f5-bae9-3b5da5d18b06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:22.585866 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bdd42218-08b9-45f5-bae9-3b5da5d18b06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:22.586646 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bdd42218-08b9-45f5-bae9-3b5da5d18b06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:22.587696 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bdd42218-08b9-45f5-bae9-3b5da5d18b06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:22.588349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bdd42218-08b9-45f5-bae9-3b5da5d18b06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:22.737163 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bdd42218-08b9-45f5-bae9-3b5da5d18b06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:22.740980 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:22.741607 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:22.746494 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bdd42218-08b9-45f5-bae9-3b5da5d18b06 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.170729 Nov 16 19:04:22.747558 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 222/422] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:22 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:22.752417 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:22.755030 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:22.755820 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:22.756254 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:22.906066 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:22.913921 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:22.916007 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:22.918364 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-aaf6e2b5-54f3-4dc6-bf66-a3a1bec8e41c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.180353 Nov 16 19:04:22.919134 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 201/423] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:22 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:23.674526 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-db464966-2755-4652-a03d-776853832c6e req-08aba9e7-6387-4db5-8f3d-595663e6c6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b188c4dd-b4cc-4a02-9ea4-901009c68534", "name": "network-vif-plugged", "status": "completed", "tag": "3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:23.676022 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:04:23.676022 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:04:23.689047 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-db464966-2755-4652-a03d-776853832c6e req-08aba9e7-6387-4db5-8f3d-595663e6c6df service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:23.689772 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-db464966-2755-4652-a03d-776853832c6e req-08aba9e7-6387-4db5-8f3d-595663e6c6df service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:23.703221 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-db464966-2755-4652-a03d-776853832c6e req-08aba9e7-6387-4db5-8f3d-595663e6c6df service nova] Creating event network-vif-plugged:3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae for instance b188c4dd-b4cc-4a02-9ea4-901009c68534 on hv-cinder-66710 Nov 16 19:04:23.708402 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-db464966-2755-4652-a03d-776853832c6e req-08aba9e7-6387-4db5-8f3d-595663e6c6df service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037343 Nov 16 19:04:23.709306 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 223/424] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:04:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:23.763434 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-763492d1-3456-4125-be6c-df70d07bcf1c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:23.764036 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-763492d1-3456-4125-be6c-df70d07bcf1c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:23.773761 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-763492d1-3456-4125-be6c-df70d07bcf1c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:23.774489 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-763492d1-3456-4125-be6c-df70d07bcf1c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:23.776118 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-763492d1-3456-4125-be6c-df70d07bcf1c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:23.776846 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-763492d1-3456-4125-be6c-df70d07bcf1c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:23.937729 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:23.938630 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:23.940351 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-763492d1-3456-4125-be6c-df70d07bcf1c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:23.945147 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:23.945808 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:23.946803 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:23.947396 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:23.948498 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-763492d1-3456-4125-be6c-df70d07bcf1c tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.189227 Nov 16 19:04:23.958783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 202/425] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:23 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:24.101599 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:24.110410 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:24.112226 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:24.114026 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ec2a28c0-522e-4260-b338-9aca59e1580f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.180775 Nov 16 19:04:24.125430 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 224/426] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:23 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:24.965249 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-dd28544c-c4a0-49c0-8bde-176b4266b897 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:24.965882 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-dd28544c-c4a0-49c0-8bde-176b4266b897 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:24.973970 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-dd28544c-c4a0-49c0-8bde-176b4266b897 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:24.974773 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-dd28544c-c4a0-49c0-8bde-176b4266b897 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:24.975597 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-dd28544c-c4a0-49c0-8bde-176b4266b897 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:24.976036 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-dd28544c-c4a0-49c0-8bde-176b4266b897 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:25.132274 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:25.134215 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:25.142874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:25.143564 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:25.144694 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:25.145328 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:25.191186 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-dd28544c-c4a0-49c0-8bde-176b4266b897 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:25.198856 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-dd28544c-c4a0-49c0-8bde-176b4266b897 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1521 microversion: 2.1 time: 0.237222 Nov 16 19:04:25.203426 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 203/427] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:24 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:25.305443 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:25.315015 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:25.316648 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:25.317918 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8308d24c-361b-4203-b96b-94dbeca52b54 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.189656 Nov 16 19:04:25.318551 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 225/428] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:25 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:25.469659 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-ae3b089c-238d-4032-a65d-e5a2a6a3a97c req-6f5d819a-e6fb-4b39-a157-d69277e232b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22ea69e-6ab3-4ba5-b12b-f940430d6649", "name": "network-vif-deleted", "tag": "856ad084-c410-48f2-95e0-5d307f2aff12"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:25.471220 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:04:25.471220 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:04:25.486412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-ae3b089c-238d-4032-a65d-e5a2a6a3a97c req-6f5d819a-e6fb-4b39-a157-d69277e232b2 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:25.486994 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-ae3b089c-238d-4032-a65d-e5a2a6a3a97c req-6f5d819a-e6fb-4b39-a157-d69277e232b2 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:25.504035 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-ae3b089c-238d-4032-a65d-e5a2a6a3a97c req-6f5d819a-e6fb-4b39-a157-d69277e232b2 service nova] Creating event network-vif-deleted:856ad084-c410-48f2-95e0-5d307f2aff12 for instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 on hv-cinder-66710 Nov 16 19:04:25.510149 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-ae3b089c-238d-4032-a65d-e5a2a6a3a97c req-6f5d819a-e6fb-4b39-a157-d69277e232b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045487 Nov 16 19:04:25.511046 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 204/429] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:04:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:26.222719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:26.224071 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:26.235421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:26.236221 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:26.238614 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:26.239254 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:26.283450 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:26.284229 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:26.285089 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lazy-loading 'fault' on Instance uuid c22ea69e-6ab3-4ba5-b12b-f940430d6649 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:04:26.332917 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbf275ba14242c49598b3bd809b51d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88aad57826ba44d19a4a8c55a7eaea31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:26.343613 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-34f4d132-9f6c-487f-8c5e-d76d654391a5 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 200 len: 1311 microversion: 2.1 time: 0.124444 Nov 16 19:04:26.354519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 226/430] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:26 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:26.354734 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:26.354734 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:26.366976 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:26.367787 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:26.368309 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:26.369336 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:26.524858 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:26.533060 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:26.534592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:26.535744 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1d715f7c-d589-4977-8989-e9821325a7c2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.203294 Nov 16 19:04:26.536301 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 205/431] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:26 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:27.362226 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:27.362927 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] [instance: c22ea69e-6ab3-4ba5-b12b-f940430d6649] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:27.370369 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:27.370934 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:27.371935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:27.372701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:27.388554 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] HTTP exception thrown: Instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 could not be found. Nov 16 19:04:27.389256 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] Returning 404 to user: Instance c22ea69e-6ab3-4ba5-b12b-f940430d6649 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:04:27.390180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8440f821-893b-4e35-bce9-eb11d9a36700 tempest-ServerRescueNegativeTestJSON-2050969256 tempest-ServerRescueNegativeTestJSON-2050969256-project] 10.222.0.46 "GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649" status: 404 len: 111 microversion: 2.1 time: 0.031981 Nov 16 19:04:27.390948 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 227/432] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:27 2021] GET /compute/v2.1/servers/c22ea69e-6ab3-4ba5-b12b-f940430d6649 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:04:27.554083 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:27.554998 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:27.562512 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:27.563120 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:27.564019 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:27.564567 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:27.810980 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:27.819238 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:27.820828 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:27.822484 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cb5aa49f-d338-4271-a868-94797dbdc956 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.272410 Nov 16 19:04:27.823032 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 206/433] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:27 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:28.841487 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:28.842795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:28.849635 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:28.850153 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:28.851180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:28.851809 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:29.027480 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:29.048525 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:29.050393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:29.051785 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-31178d52-bcf4-467d-8fe4-706e7d9547cd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.214523 Nov 16 19:04:29.052864 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 228/434] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:28 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:30.071164 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:30.072573 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:30.092562 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:30.094110 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:30.098365 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:30.099052 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:30.305047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:30.313956 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:30.315756 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:30.317088 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b80444a7-eb8d-4027-900a-21e6a5c9e731 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.249997 Nov 16 19:04:30.320709 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 207/435] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:30 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:31.335477 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:31.336404 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:31.362025 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:31.363228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:31.365092 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:31.365539 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:31.546584 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:31.556483 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:31.558288 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:31.559667 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-587314c2-9d6a-4147-b62f-fc0463844196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.228002 Nov 16 19:04:31.560858 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 229/436] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:31 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:32.578070 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:32.578629 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:32.584728 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:32.585174 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:32.585972 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:32.586406 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:32.718971 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:32.727208 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:32.728756 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:32.729850 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f16bcf71-2f08-4756-adc5-cf74c31307e5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.155539 Nov 16 19:04:32.730403 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 208/437] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:32 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:33.747800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:33.748401 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:33.754669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:33.755116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:33.755908 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:33.756366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:33.892872 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:33.901833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:33.903329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:33.904486 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-56df10a4-ae6f-46b0-ad7f-850a32c2378e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.160446 Nov 16 19:04:33.905329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 230/438] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:33 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:34.922146 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:34.922744 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:34.928892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:34.929338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:34.930163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:34.931169 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:35.054990 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:35.063296 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:35.064734 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:35.065921 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3e804534-df7d-4ea5-b494-2b71a5ce4cee tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1737 microversion: 2.20 time: 0.147448 Nov 16 19:04:35.066484 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 209/439] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:34 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:36.083314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:36.084190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:36.090853 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:36.091301 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:36.092078 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:36.092511 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:36.143646 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f2b75c53-5b09-443b-999f-d92c3cb7f35d tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa56d5b040>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:36.190223 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f2b75c53-5b09-443b-999f-d92c3cb7f35d tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/10291f6a-e53c-439f-b207-c17e1d04a6cd" status: 200 len: 351 microversion: 2.1 time: 0.050098 Nov 16 19:04:36.190814 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 210/440] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:04:36 2021] GET /compute/v2.1/os-volumes/10291f6a-e53c-439f-b207-c17e1d04a6cd => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:04:36.221812 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:36.230083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:36.231638 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:36.232855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ea612286-fb01-47a5-9040-ccf80f18e460 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1719 microversion: 2.20 time: 0.153240 Nov 16 19:04:36.233486 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 231/441] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:36 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:37.252482 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:37.253062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:37.262468 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:37.262915 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:37.263688 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:37.264124 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:37.395110 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:37.403306 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:37.404785 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:37.405939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-06626a8f-9410-42bd-be0a-41cc83b4e80e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1719 microversion: 2.20 time: 0.157657 Nov 16 19:04:37.406481 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 211/442] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:37 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:38.424434 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:38.425022 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:38.431290 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:38.431726 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:38.432489 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:38.432915 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:38.559242 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:38.566825 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:38.568305 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:38.569445 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b922ddd7-4e85-4704-852a-fbf3d3a32501 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1719 microversion: 2.20 time: 0.148715 Nov 16 19:04:38.570082 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 232/443] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:38 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:39.582742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4fc99ebb-9dd5-416a-b36c-fe396d4d05e0 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa5772db80>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:39.588466 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:39.589086 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:39.596242 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:39.596664 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:39.598031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:39.598502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:39.631358 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4fc99ebb-9dd5-416a-b36c-fe396d4d05e0 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/8610d805-a805-44b1-b53a-0fcb55468989" status: 200 len: 350 microversion: 2.1 time: 0.052828 Nov 16 19:04:39.632538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 212/444] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:04:39 2021] GET /compute/v2.1/os-volumes/8610d805-a805-44b1-b53a-0fcb55468989 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:39.637038 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-313a980d-7039-4761-b0d9-7ead5d447814 req-1d76c77b-31d3-4b59-a78b-05d2b0f42d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b188c4dd-b4cc-4a02-9ea4-901009c68534", "name": "network-vif-unplugged", "status": "completed", "tag": "3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:39.638791 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:04:39.638791 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:04:39.647333 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-313a980d-7039-4761-b0d9-7ead5d447814 req-1d76c77b-31d3-4b59-a78b-05d2b0f42d42 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:39.647785 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-313a980d-7039-4761-b0d9-7ead5d447814 req-1d76c77b-31d3-4b59-a78b-05d2b0f42d42 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:39.658991 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-313a980d-7039-4761-b0d9-7ead5d447814 req-1d76c77b-31d3-4b59-a78b-05d2b0f42d42 service nova] Creating event network-vif-unplugged:3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae for instance b188c4dd-b4cc-4a02-9ea4-901009c68534 on hv-cinder-66710 Nov 16 19:04:39.664334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-313a980d-7039-4761-b0d9-7ead5d447814 req-1d76c77b-31d3-4b59-a78b-05d2b0f42d42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030600 Nov 16 19:04:39.665871 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 213/445] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:04:39 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:39.743240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:39.751419 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:39.752903 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:39.754076 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e05de037-6015-4b15-9929-21dbd91d9d53 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1722 microversion: 2.20 time: 0.170094 Nov 16 19:04:39.754622 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 233/446] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:39 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:39.772636 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4d583c0d-ea2a-4e63-9226-2d8c8529817f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b40b3380-c96b-4a9f-b045-032a551645c7"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:39.774394 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4d583c0d-ea2a-4e63-9226-2d8c8529817f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:39.780572 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4d583c0d-ea2a-4e63-9226-2d8c8529817f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:39.781022 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4d583c0d-ea2a-4e63-9226-2d8c8529817f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:39.781848 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4d583c0d-ea2a-4e63-9226-2d8c8529817f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:39.782286 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4d583c0d-ea2a-4e63-9226-2d8c8529817f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:40.062925 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4d583c0d-ea2a-4e63-9226-2d8c8529817f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294725 Nov 16 19:04:40.063496 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 214/447] 10.222.0.46 () {62 vars in 1363 bytes} [Tue Nov 16 19:04:39 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:04:40.179582 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2ae2f3d9-f71b-404f-b566-f3f419c03e49 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:40.180375 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2ae2f3d9-f71b-404f-b566-f3f419c03e49 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:40.186665 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae2f3d9-f71b-404f-b566-f3f419c03e49 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:40.189756 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae2f3d9-f71b-404f-b566-f3f419c03e49 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:40.189756 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae2f3d9-f71b-404f-b566-f3f419c03e49 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:40.189756 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae2f3d9-f71b-404f-b566-f3f419c03e49 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:40.276675 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2ae2f3d9-f71b-404f-b566-f3f419c03e49 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action" status: 202 len: 0 microversion: 2.20 time: 0.100894 Nov 16 19:04:40.277540 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 234/448] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:04:40 2021] POST /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:04:40.286054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:40.286666 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:40.293496 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:40.293964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:40.294936 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:40.295358 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:40.429930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:40.438793 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:40.440270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:40.441440 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c7641d48-9806-43b3-b8d3-7e365f160b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1748 microversion: 2.20 time: 0.159332 Nov 16 19:04:40.442056 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 215/449] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:40 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:40.972110 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d04b4f1c-b854-4b77-82bf-b25fac994c5c tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa56f419d0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.019237 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d04b4f1c-b854-4b77-82bf-b25fac994c5c tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b00c6ec6-26f1-48fe-b606-312f89d8d6eb" status: 200 len: 349 microversion: 2.1 time: 0.050992 Nov 16 19:04:41.019957 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 235/450] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:04:40 2021] GET /compute/v2.1/os-volumes/b00c6ec6-26f1-48fe-b606-312f89d8d6eb => generated 349 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:41.031412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7a705379-045b-4dfa-8e0f-b359ddf2577d tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa56d77670>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.110025 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7a705379-045b-4dfa-8e0f-b359ddf2577d tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.082205 Nov 16 19:04:41.110588 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 216/451] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:41.122801 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-00c24cdf-c5d0-4cac-b898-0b443a538277 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa56ef33a0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.203497 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-00c24cdf-c5d0-4cac-b898-0b443a538277 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.084299 Nov 16 19:04:41.204322 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 236/452] 10.222.0.46 () {58 vars in 1148 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:41.217387 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f725ca55-bb90-43cf-9558-e959f2a0a515 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa576cf550>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.313425 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f725ca55-bb90-43cf-9558-e959f2a0a515 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.099531 Nov 16 19:04:41.314167 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 217/453] 10.222.0.46 () {58 vars in 1133 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:41.324911 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e4a184e4-735d-4b54-b712-27f73475c298 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa5c102310>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.416022 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e4a184e4-735d-4b54-b712-27f73475c298 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093811 Nov 16 19:04:41.416610 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 237/454] 10.222.0.46 () {58 vars in 1166 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:41.428399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d5624dd9-e47f-4064-99fb-454ef6702db9 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa576b50d0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.460629 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.461362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:41.469026 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:41.469473 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:41.470274 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:41.470708 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:41.508448 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d5624dd9-e47f-4064-99fb-454ef6702db9 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.083720 Nov 16 19:04:41.509534 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 218/455] 10.222.0.46 () {58 vars in 1169 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:41.521234 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2c0ac02c-d8df-465d-be4e-6f50c8c87dba tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa56d773a0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.601964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2c0ac02c-d8df-465d-be4e-6f50c8c87dba tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084035 Nov 16 19:04:41.602530 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 219/456] 10.222.0.46 () {58 vars in 1154 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:04:41.605668 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:41.613434 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9c3755b2-956e-44e2-a232-7a0431217705 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa5cad9940>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.614225 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:41.615753 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:41.616905 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dd4cd92f-2402-4e2a-a965-faa0828f924b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1750 microversion: 2.20 time: 0.160005 Nov 16 19:04:41.617516 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 238/457] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:04:41.691687 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9c3755b2-956e-44e2-a232-7a0431217705 tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081758 Nov 16 19:04:41.692241 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 220/458] 10.222.0.46 () {58 vars in 1187 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:04:41.704160 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-029f0252-f3a2-40b1-8c36-1e4e8dd4206f tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] Calling method '.version_select at 0x7ffa56dbab80>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:41.785678 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-029f0252-f3a2-40b1-8c36-1e4e8dd4206f tempest-VolumesTestJSON-1106538938 tempest-VolumesTestJSON-1106538938-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085007 Nov 16 19:04:41.786367 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 239/459] 10.222.0.46 () {58 vars in 1154 bytes} [Tue Nov 16 19:04:41 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:42.636895 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:42.637488 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:42.643390 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:42.643832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:42.644595 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:42.645021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:42.881145 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:42.890263 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:42.891744 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:42.892884 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-921868bc-4fa0-4965-b1d7-d2c7e5a2f982 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.261114 Nov 16 19:04:42.893430 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 221/460] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:42 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:43.415000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3ecd95cc-d84d-48c4-b5a8-4133669a57bd tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:43.417116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3ecd95cc-d84d-48c4-b5a8-4133669a57bd tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:43.424151 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ecd95cc-d84d-48c4-b5a8-4133669a57bd tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:43.424597 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ecd95cc-d84d-48c4-b5a8-4133669a57bd tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:43.425384 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ecd95cc-d84d-48c4-b5a8-4133669a57bd tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:43.425858 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ecd95cc-d84d-48c4-b5a8-4133669a57bd tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:43.595374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-3ecd95cc-d84d-48c4-b5a8-4133669a57bd tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lazy-loading 'services' on Instance uuid 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:04:43.715411 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3ecd95cc-d84d-48c4-b5a8-4133669a57bd tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e/os-volume_attachments/c27eb627-f628-4c19-86c6-664b6ec48cd1" status: 202 len: 0 microversion: 2.1 time: 0.310921 Nov 16 19:04:43.716548 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 240/461] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:04:43 2021] DELETE /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e/os-volume_attachments/c27eb627-f628-4c19-86c6-664b6ec48cd1 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:04:43.930284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:43.930921 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:43.937456 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:43.937917 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:43.938912 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:43.939339 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:44.106934 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:44.115633 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:44.123908 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:44.125190 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7787ef4f-be1e-4083-b5af-292ef1a5dad1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.217648 Nov 16 19:04:44.126113 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 222/462] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:43 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:45.144428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:45.145112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:45.151156 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:45.151596 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:45.152357 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:45.152786 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:45.305304 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:45.316458 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:45.318243 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:45.319603 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e0b85025-269b-4149-8931-798b84f501ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.179639 Nov 16 19:04:45.331117 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 241/463] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:45 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:46.337584 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:46.339092 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:46.346668 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:46.347097 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:46.347888 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:46.348319 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:46.494293 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:46.494572 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:04:46.495104 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: Tue Nov 16 19:04:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:04:46.509657 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:46.511431 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:46.512618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0f1d2985-9f2d-42c6-8b50-29a00dfbbf12 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.178850 Nov 16 19:04:46.513176 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 223/464] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:46 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:47.534362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:47.534362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:47.539734 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:47.541414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:47.542060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:47.542500 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:47.688498 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:47.696730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:47.698260 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:47.699402 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-939267a7-d5eb-4977-8c43-db3f7944ec7c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.171041 Nov 16 19:04:47.699957 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 242/465] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:47 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:48.717269 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:48.717912 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:48.724615 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:48.725129 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:48.726099 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:48.726606 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:48.880579 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:48.889614 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:48.891115 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:48.892290 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d02226e5-5e97-477d-9d6a-e7163253997f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.178737 Nov 16 19:04:48.892845 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 224/466] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:48 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:49.913393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:49.915455 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:49.925160 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:49.926301 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:49.927499 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:49.928083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:50.084033 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:50.109336 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:50.111971 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:50.114328 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eba6df7c-9568-43fc-a4b5-5e49bfbb2f40 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.206304 Nov 16 19:04:50.117032 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 243/467] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:49 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:51.134923 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:51.135563 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:51.142094 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:51.142536 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:51.143310 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:51.143742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:51.298868 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:51.308693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:51.310277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:51.311547 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3c14a073-7012-4fd2-9819-dc853d1802ad tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.181684 Nov 16 19:04:51.312108 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 225/468] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:51 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:52.330353 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:52.330981 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:52.337446 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:52.338008 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:52.338843 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:52.339355 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:52.506466 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:52.515659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:52.517134 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:52.518314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a58536a4-99da-4de5-a9de-1f5f1d816b0d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.191795 Nov 16 19:04:52.518869 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 244/469] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:52 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:53.535726 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:53.536334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:53.543056 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:53.543494 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:53.544277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:53.553710 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:53.714462 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:53.725287 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:53.727946 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:53.729507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-67a0c371-bef4-4176-920d-b4804512e258 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.197381 Nov 16 19:04:53.741071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 226/470] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:53 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:54.750593 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:54.752425 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:54.761326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:54.762219 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:54.763084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:54.763571 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:54.898979 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:54.907451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:54.908938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:54.910174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d1704a06-a0bc-4142-b09e-42047aae8f1d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.164752 Nov 16 19:04:54.910925 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 245/471] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:54 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:55.928654 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:55.929386 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:55.935888 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:55.936328 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:55.937089 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:55.937516 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:56.072434 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:56.082739 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:56.084448 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:56.085722 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a871afe8-c09e-4c40-8ca7-8724cdd7e999 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.161319 Nov 16 19:04:56.086352 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 227/472] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:55 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:56.523824 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-45ec7bb2-c558-40e8-9150-23bd3f934c2d tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:56.524360 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-45ec7bb2-c558-40e8-9150-23bd3f934c2d tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:56.530639 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45ec7bb2-c558-40e8-9150-23bd3f934c2d tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:56.531083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45ec7bb2-c558-40e8-9150-23bd3f934c2d tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:56.531854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45ec7bb2-c558-40e8-9150-23bd3f934c2d tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:56.532287 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45ec7bb2-c558-40e8-9150-23bd3f934c2d tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:56.557110 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-45ec7bb2-c558-40e8-9150-23bd3f934c2d tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:04:56.629366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-45ec7bb2-c558-40e8-9150-23bd3f934c2d tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 204 len: 0 microversion: 2.1 time: 0.108892 Nov 16 19:04:56.630411 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 246/473] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:04:56 2021] DELETE /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:04:56.640289 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7ad398e6-224b-4dff-9264-57700ef04673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:56.640891 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7ad398e6-224b-4dff-9264-57700ef04673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:56.646580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ad398e6-224b-4dff-9264-57700ef04673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:56.647016 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ad398e6-224b-4dff-9264-57700ef04673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:56.647779 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ad398e6-224b-4dff-9264-57700ef04673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:56.648205 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ad398e6-224b-4dff-9264-57700ef04673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:56.780471 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7ad398e6-224b-4dff-9264-57700ef04673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:56.787852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7ad398e6-224b-4dff-9264-57700ef04673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1514 microversion: 2.1 time: 0.152311 Nov 16 19:04:56.788722 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 228/474] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:56 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:57.105293 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:57.106143 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:57.112272 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:57.112717 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:57.113659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:57.113941 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:57.244660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:57.253215 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:57.254882 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:57.256116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-210f9e53-2aa6-4af8-89a8-ef3c243e2cb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.155976 Nov 16 19:04:57.256671 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 247/475] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:57 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:57.470234 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5cf4fc5b-923e-4a94-b971-d7f9f36737f4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:57.470807 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5cf4fc5b-923e-4a94-b971-d7f9f36737f4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:57.476924 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5cf4fc5b-923e-4a94-b971-d7f9f36737f4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:57.477367 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5cf4fc5b-923e-4a94-b971-d7f9f36737f4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:57.478162 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5cf4fc5b-923e-4a94-b971-d7f9f36737f4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:57.478594 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5cf4fc5b-923e-4a94-b971-d7f9f36737f4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:57.553432 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-5cf4fc5b-923e-4a94-b971-d7f9f36737f4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lazy-loading 'services' on Instance uuid 7190b8e5-4def-4b46-bf21-dae43664c0ad {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:04:57.619888 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5cf4fc5b-923e-4a94-b971-d7f9f36737f4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/os-volume_attachments/5ca19f6c-03ab-458e-9723-5b51d5a5d826" status: 202 len: 0 microversion: 2.1 time: 0.153071 Nov 16 19:04:57.620813 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 229/476] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:04:57 2021] DELETE /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/os-volume_attachments/5ca19f6c-03ab-458e-9723-5b51d5a5d826 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:04:57.803944 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-547ec2b2-a90d-4205-af6d-2a337346c6f5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:57.804548 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-547ec2b2-a90d-4205-af6d-2a337346c6f5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:57.811323 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-547ec2b2-a90d-4205-af6d-2a337346c6f5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:57.811770 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-547ec2b2-a90d-4205-af6d-2a337346c6f5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:57.812539 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-547ec2b2-a90d-4205-af6d-2a337346c6f5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:57.812973 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-547ec2b2-a90d-4205-af6d-2a337346c6f5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:57.939154 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-547ec2b2-a90d-4205-af6d-2a337346c6f5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:57.946433 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-547ec2b2-a90d-4205-af6d-2a337346c6f5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1514 microversion: 2.1 time: 0.146112 Nov 16 19:04:57.946984 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 248/477] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:57 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:58.275956 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:58.276714 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:58.282967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:58.283412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:58.284211 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:58.284685 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:58.467607 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:58.476598 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:58.478136 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:58.479283 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c8f2b614-3683-4929-8aed-95a71a320361 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.208510 Nov 16 19:04:58.479856 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 230/478] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:58 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:04:58.723448 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7532d01e-d6a0-4b82-bd55-d734d373b7b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:58.730324 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7532d01e-d6a0-4b82-bd55-d734d373b7b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:58.730764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7532d01e-d6a0-4b82-bd55-d734d373b7b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:58.753621 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7532d01e-d6a0-4b82-bd55-d734d373b7b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Going to try to stop instance {{(pid=116168) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 16 19:04:58.801068 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7532d01e-d6a0-4b82-bd55-d734d373b7b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 202 len: 0 microversion: 2.1 time: 0.080971 Nov 16 19:04:58.801748 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 249/479] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:04:58 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:04:58.810121 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cbce32ca-88d9-4987-a778-1d86fa9d4e9c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:58.810736 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cbce32ca-88d9-4987-a778-1d86fa9d4e9c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:58.817904 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbce32ca-88d9-4987-a778-1d86fa9d4e9c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:58.818443 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbce32ca-88d9-4987-a778-1d86fa9d4e9c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:58.819232 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbce32ca-88d9-4987-a778-1d86fa9d4e9c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:58.819779 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbce32ca-88d9-4987-a778-1d86fa9d4e9c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:58.965042 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ab7bb07a-2c9a-47cc-a7ef-e2c19f48c8a5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:58.965945 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ab7bb07a-2c9a-47cc-a7ef-e2c19f48c8a5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:58.971902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ab7bb07a-2c9a-47cc-a7ef-e2c19f48c8a5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:58.972344 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ab7bb07a-2c9a-47cc-a7ef-e2c19f48c8a5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:58.973119 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ab7bb07a-2c9a-47cc-a7ef-e2c19f48c8a5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:58.973570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ab7bb07a-2c9a-47cc-a7ef-e2c19f48c8a5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:59.123023 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ab7bb07a-2c9a-47cc-a7ef-e2c19f48c8a5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:59.130295 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ab7bb07a-2c9a-47cc-a7ef-e2c19f48c8a5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 200 len: 1514 microversion: 2.1 time: 0.170235 Nov 16 19:04:59.130860 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 250/480] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:58 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:04:59.139594 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cbce32ca-88d9-4987-a778-1d86fa9d4e9c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:59.147805 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cbce32ca-88d9-4987-a778-1d86fa9d4e9c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.341674 Nov 16 19:04:59.148453 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 231/481] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:04:58 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:04:59.166009 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-513ade56-517c-4389-9a74-6fc4630bfcb1 req-50c21b17-6ba2-44f0-9206-26d12182aad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b93c2-1aa0-4417-bf2a-f3d581ae658e", "name": "network-vif-deleted", "tag": "c0944e2a-6a82-4783-8c2e-ac416340d13d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:04:59.167551 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:04:59.167551 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:04:59.174317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-513ade56-517c-4389-9a74-6fc4630bfcb1 req-50c21b17-6ba2-44f0-9206-26d12182aad2 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:59.174758 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-513ade56-517c-4389-9a74-6fc4630bfcb1 req-50c21b17-6ba2-44f0-9206-26d12182aad2 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:59.186289 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-513ade56-517c-4389-9a74-6fc4630bfcb1 req-50c21b17-6ba2-44f0-9206-26d12182aad2 service nova] Creating event network-vif-deleted:c0944e2a-6a82-4783-8c2e-ac416340d13d for instance 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e on hv-cinder-66710 Nov 16 19:04:59.190925 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-513ade56-517c-4389-9a74-6fc4630bfcb1 req-50c21b17-6ba2-44f0-9206-26d12182aad2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028507 Nov 16 19:04:59.191559 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 251/482] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:04:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:04:59.497641 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:04:59.498336 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:04:59.504498 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:59.505007 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:59.505889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:04:59.506381 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:04:59.647892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:59.657522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:59.659356 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:04:59.660751 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3241be86-f811-46ea-a37b-0a3f2357597e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.166683 Nov 16 19:04:59.661413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 232/483] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:04:59 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:00.148108 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:00.148825 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:00.156010 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:00.156641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:00.157669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:00.158186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:00.165413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0f2a5315-ccf6-408e-a605-16edb33a16bf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:00.166062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0f2a5315-ccf6-408e-a605-16edb33a16bf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:00.172388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f2a5315-ccf6-408e-a605-16edb33a16bf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:00.172944 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f2a5315-ccf6-408e-a605-16edb33a16bf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:00.173904 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f2a5315-ccf6-408e-a605-16edb33a16bf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:00.174446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f2a5315-ccf6-408e-a605-16edb33a16bf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:00.182027 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] HTTP exception thrown: Instance 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e could not be found. Nov 16 19:05:00.182631 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Returning 404 to user: Instance 1f4b93c2-1aa0-4417-bf2a-f3d581ae658e could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:05:00.183587 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e308c47b-ef5a-4a3d-b581-8cfafb6a3f4c tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e" status: 404 len: 111 microversion: 2.1 time: 0.039969 Nov 16 19:05:00.187547 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 252/484] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:00 2021] GET /compute/v2.1/servers/1f4b93c2-1aa0-4417-bf2a-f3d581ae658e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:05:00.404117 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0f2a5315-ccf6-408e-a605-16edb33a16bf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:00.411453 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0f2a5315-ccf6-408e-a605-16edb33a16bf tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.250126 Nov 16 19:05:00.412194 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 233/485] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:00 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:05:00.678982 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:00.679611 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:00.686101 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:00.686677 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:00.687442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:00.687870 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:00.822775 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:00.830858 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:00.832344 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:00.833487 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e6b4c3a5-6551-4147-83af-f5440b421572 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.158136 Nov 16 19:05:00.834112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 253/486] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:00 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:01.428059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-284d1b18-79eb-4117-9d4c-b512ea0f9591 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:01.428746 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-284d1b18-79eb-4117-9d4c-b512ea0f9591 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:01.435053 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-284d1b18-79eb-4117-9d4c-b512ea0f9591 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:01.435490 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-284d1b18-79eb-4117-9d4c-b512ea0f9591 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:01.436251 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-284d1b18-79eb-4117-9d4c-b512ea0f9591 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:01.436674 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-284d1b18-79eb-4117-9d4c-b512ea0f9591 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:01.565577 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-284d1b18-79eb-4117-9d4c-b512ea0f9591 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:01.572986 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-284d1b18-79eb-4117-9d4c-b512ea0f9591 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.148515 Nov 16 19:05:01.573738 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 234/487] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:01 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:01.851235 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:01.851884 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:01.858348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:01.858793 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:01.859553 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:01.859980 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:01.988307 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:01.996346 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:01.997854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:01.999001 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c132338c-6f80-4b62-8d6c-40b054ae80e6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.151382 Nov 16 19:05:01.999546 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 254/488] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:01 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:02.590018 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2cb747da-71e3-466d-a672-f9cd071be3dc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:02.590625 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2cb747da-71e3-466d-a672-f9cd071be3dc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:02.596786 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2cb747da-71e3-466d-a672-f9cd071be3dc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:02.597235 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2cb747da-71e3-466d-a672-f9cd071be3dc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:02.598038 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2cb747da-71e3-466d-a672-f9cd071be3dc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:02.598474 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2cb747da-71e3-466d-a672-f9cd071be3dc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:02.726188 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2cb747da-71e3-466d-a672-f9cd071be3dc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:02.733359 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2cb747da-71e3-466d-a672-f9cd071be3dc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.147008 Nov 16 19:05:02.733952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 235/489] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:02 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:03.018002 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:03.018502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:03.024618 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:03.025062 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:03.025851 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:03.026278 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:03.154887 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:03.162870 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:03.164349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:03.165478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a5393f78-8e2e-4056-a2d8-946d687c2a68 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.151207 Nov 16 19:05:03.166049 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 255/490] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:03 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:03.750096 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4ddb645c-afbf-49cf-9d28-d102d55daa00 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:03.750697 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4ddb645c-afbf-49cf-9d28-d102d55daa00 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:03.757141 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4ddb645c-afbf-49cf-9d28-d102d55daa00 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:03.757636 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4ddb645c-afbf-49cf-9d28-d102d55daa00 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:03.759024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4ddb645c-afbf-49cf-9d28-d102d55daa00 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:03.759453 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4ddb645c-afbf-49cf-9d28-d102d55daa00 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:03.886342 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4ddb645c-afbf-49cf-9d28-d102d55daa00 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:03.893437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4ddb645c-afbf-49cf-9d28-d102d55daa00 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.147011 Nov 16 19:05:03.894032 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 236/491] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:03 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:04.184149 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:04.184697 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:04.190825 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:04.191273 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:04.192032 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:04.192457 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:04.318618 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:04.326656 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:04.328140 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:04.329273 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a1196bdc-f89f-46cc-b9a7-551e3d37c516 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.149459 Nov 16 19:05:04.329874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 256/492] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:04 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:04.910440 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-afd58f6b-c580-47e1-af1e-e654b287c884 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:04.912211 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-afd58f6b-c580-47e1-af1e-e654b287c884 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:04.920145 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-afd58f6b-c580-47e1-af1e-e654b287c884 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:04.920596 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-afd58f6b-c580-47e1-af1e-e654b287c884 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:04.921402 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-afd58f6b-c580-47e1-af1e-e654b287c884 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:04.922053 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-afd58f6b-c580-47e1-af1e-e654b287c884 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:05.056569 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-afd58f6b-c580-47e1-af1e-e654b287c884 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:05.064194 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-afd58f6b-c580-47e1-af1e-e654b287c884 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.157496 Nov 16 19:05:05.064880 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 237/493] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:04 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:05.348158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:05.348764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:05.356041 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:05.356512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:05.357299 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:05.357764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:05.487432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:05.495639 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:05.497146 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:05.498334 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d5d16cb5-e4b0-4472-a8b5-aee830b55a51 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.154498 Nov 16 19:05:05.498939 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 257/494] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:05 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:05:06.081274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-af8aacba-c4a9-4f1b-9d46-2abb3cf38f29 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:06.081906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-af8aacba-c4a9-4f1b-9d46-2abb3cf38f29 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:06.088590 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-af8aacba-c4a9-4f1b-9d46-2abb3cf38f29 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:06.089031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-af8aacba-c4a9-4f1b-9d46-2abb3cf38f29 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:06.089907 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-af8aacba-c4a9-4f1b-9d46-2abb3cf38f29 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:06.090340 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-af8aacba-c4a9-4f1b-9d46-2abb3cf38f29 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:06.222777 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-af8aacba-c4a9-4f1b-9d46-2abb3cf38f29 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:06.230888 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-af8aacba-c4a9-4f1b-9d46-2abb3cf38f29 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.153258 Nov 16 19:05:06.231444 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 238/495] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:06 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:06.517607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:06.518216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:06.525017 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:06.525464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:06.526264 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:06.526696 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:06.678855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:06.687626 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:06.689097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:06.690423 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-69c8ba40-1c42-4d21-ba30-677f491a10ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.176338 Nov 16 19:05:06.691115 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 258/496] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:06 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:07.247826 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f3d3a486-726b-499e-8266-ae8f6db6d194 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:07.248352 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f3d3a486-726b-499e-8266-ae8f6db6d194 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:07.254545 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3d3a486-726b-499e-8266-ae8f6db6d194 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:07.254985 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3d3a486-726b-499e-8266-ae8f6db6d194 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:07.255740 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3d3a486-726b-499e-8266-ae8f6db6d194 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:07.256164 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f3d3a486-726b-499e-8266-ae8f6db6d194 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:07.384022 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f3d3a486-726b-499e-8266-ae8f6db6d194 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:07.391210 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f3d3a486-726b-499e-8266-ae8f6db6d194 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.147047 Nov 16 19:05:07.391763 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 239/497] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:07 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:07.708998 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:07.709592 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:07.715774 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:07.716217 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:07.716970 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:07.717397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:07.843655 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:07.852317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:07.853835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:07.854963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2e9d5fdf-0ae5-408d-b3c5-4f0677544c35 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.149624 Nov 16 19:05:07.855503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 259/498] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:07 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:08.408371 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a85f4ce6-cb27-4334-b8f0-9941cd6a9148 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:08.409006 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a85f4ce6-cb27-4334-b8f0-9941cd6a9148 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:08.415427 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a85f4ce6-cb27-4334-b8f0-9941cd6a9148 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:08.415870 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a85f4ce6-cb27-4334-b8f0-9941cd6a9148 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:08.416643 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a85f4ce6-cb27-4334-b8f0-9941cd6a9148 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:08.417076 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a85f4ce6-cb27-4334-b8f0-9941cd6a9148 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:08.542803 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a85f4ce6-cb27-4334-b8f0-9941cd6a9148 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:08.549939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a85f4ce6-cb27-4334-b8f0-9941cd6a9148 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.145180 Nov 16 19:05:08.550490 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 240/499] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:08 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:08.873867 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:08.874491 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:08.880767 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:08.881209 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:08.882257 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:08.882687 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:09.013410 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:09.021637 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:09.023272 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:09.024919 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cbc60944-6f9d-4ff3-a076-5407a8a90fe2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.154750 Nov 16 19:05:09.025514 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 260/500] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:08 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:09.143622 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1538487735", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "734c5c23-6b90-4051-923f-6327396b1039"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:05:09.192942 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] validate_networks() for [('734c5c23-6b90-4051-923f-6327396b1039', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:05:09.539852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:05:09.540343 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:05:09.540730 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:05:09.541138 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:05:09.541568 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:05:09.551129 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:09.551634 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:09.552380 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:09.552812 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:09.566698 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-52b547d6-3711-4594-a0f4-630ae7d6c7a0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:09.567317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-52b547d6-3711-4594-a0f4-630ae7d6c7a0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:09.570219 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Getting quotas for project 16e9cbea1c0e436b8c518eaa18d7b74c. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:05:09.574706 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52b547d6-3711-4594-a0f4-630ae7d6c7a0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:09.574903 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Getting quotas for user 6f7dbeb8d8c143bd97ff13e0be4b4fb0 and project 16e9cbea1c0e436b8c518eaa18d7b74c. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:05:09.576903 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52b547d6-3711-4594-a0f4-630ae7d6c7a0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:09.577775 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52b547d6-3711-4594-a0f4-630ae7d6c7a0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:09.578208 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52b547d6-3711-4594-a0f4-630ae7d6c7a0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:09.586440 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:05:09.588775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:05:09.635181 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a413b9fa-afbe-4bbb-98a4-c3129f524ac5 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495126 Nov 16 19:05:09.640667 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 241/501] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:05:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:05:09.646216 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8f43f35a-53b5-4810-8745-c21f71a5fe7f tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:09.647004 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8f43f35a-53b5-4810-8745-c21f71a5fe7f tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:09.711893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-52b547d6-3711-4594-a0f4-630ae7d6c7a0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:09.712524 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-8f43f35a-53b5-4810-8745-c21f71a5fe7f tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:09.719410 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8f43f35a-53b5-4810-8745-c21f71a5fe7f tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1219 microversion: 2.1 time: 0.077172 Nov 16 19:05:09.719600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-52b547d6-3711-4594-a0f4-630ae7d6c7a0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.156446 Nov 16 19:05:09.729594 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 261/502] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:09 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:05:09.729706 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 242/503] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:09 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:10.043850 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:10.044519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:10.050943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:10.051388 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:10.052172 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:10.052604 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:10.200080 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:10.208670 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:10.210341 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:10.211846 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-190e8df7-6130-4db2-96d7-966271758397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.172331 Nov 16 19:05:10.212752 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 262/504] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:10 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:10.738043 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2ab1a456-52ff-4949-b1e3-4a202ba1a54a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:10.738634 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2ab1a456-52ff-4949-b1e3-4a202ba1a54a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:10.744414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2bf125f4-bfbc-4e51-8735-f01c21a619af tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:10.744939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ab1a456-52ff-4949-b1e3-4a202ba1a54a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:10.745067 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2bf125f4-bfbc-4e51-8735-f01c21a619af tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:10.745383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ab1a456-52ff-4949-b1e3-4a202ba1a54a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:10.746198 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ab1a456-52ff-4949-b1e3-4a202ba1a54a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:10.746753 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ab1a456-52ff-4949-b1e3-4a202ba1a54a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:10.751056 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2bf125f4-bfbc-4e51-8735-f01c21a619af tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:10.751510 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2bf125f4-bfbc-4e51-8735-f01c21a619af tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:10.752301 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2bf125f4-bfbc-4e51-8735-f01c21a619af tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:10.752737 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2bf125f4-bfbc-4e51-8735-f01c21a619af tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:10.814762 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2bf125f4-bfbc-4e51-8735-f01c21a619af tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:10.822570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2bf125f4-bfbc-4e51-8735-f01c21a619af tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1277 microversion: 2.1 time: 0.090161 Nov 16 19:05:10.823408 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 263/505] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:10 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:10.975380 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2ab1a456-52ff-4949-b1e3-4a202ba1a54a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:10.983533 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2ab1a456-52ff-4949-b1e3-4a202ba1a54a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.249660 Nov 16 19:05:10.984292 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 243/506] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:10 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:05:11.089464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-5f70af6f-77f3-483b-a33f-36fd1cda308d req-58bbd236-4ac8-4539-b2b0-9fbaf944c4ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b188c4dd-b4cc-4a02-9ea4-901009c68534", "name": "network-vif-plugged", "status": "completed", "tag": "3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:05:11.091781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:05:11.091781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:05:11.099532 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-5f70af6f-77f3-483b-a33f-36fd1cda308d req-58bbd236-4ac8-4539-b2b0-9fbaf944c4ab service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:11.099871 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-5f70af6f-77f3-483b-a33f-36fd1cda308d req-58bbd236-4ac8-4539-b2b0-9fbaf944c4ab service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:11.113185 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-5f70af6f-77f3-483b-a33f-36fd1cda308d req-58bbd236-4ac8-4539-b2b0-9fbaf944c4ab service nova] Creating event network-vif-plugged:3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae for instance b188c4dd-b4cc-4a02-9ea4-901009c68534 on hv-cinder-66710 Nov 16 19:05:11.118757 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-5f70af6f-77f3-483b-a33f-36fd1cda308d req-58bbd236-4ac8-4539-b2b0-9fbaf944c4ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033022 Nov 16 19:05:11.119339 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 264/507] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:05:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:05:11.234223 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:11.235493 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:11.242041 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:11.242517 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:11.243484 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:11.244060 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:11.449959 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:11.459272 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:11.460798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:11.466727 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e84b2fef-de17-444a-826c-1014857f95bd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.239001 Nov 16 19:05:11.477977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 244/508] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:11 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:11.839760 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5971590c-63e7-4b93-9d26-4043024e8cf3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:11.840538 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5971590c-63e7-4b93-9d26-4043024e8cf3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:11.846668 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5971590c-63e7-4b93-9d26-4043024e8cf3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:11.847200 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5971590c-63e7-4b93-9d26-4043024e8cf3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:11.848048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5971590c-63e7-4b93-9d26-4043024e8cf3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:11.848713 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5971590c-63e7-4b93-9d26-4043024e8cf3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:11.984469 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5971590c-63e7-4b93-9d26-4043024e8cf3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:11.991785 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5971590c-63e7-4b93-9d26-4043024e8cf3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1319 microversion: 2.1 time: 0.156083 Nov 16 19:05:11.992864 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 265/509] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:11 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:11.999766 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1d4832fe-4b71-4c39-8b6b-ef8c162368d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:12.000374 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1d4832fe-4b71-4c39-8b6b-ef8c162368d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:12.007399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d4832fe-4b71-4c39-8b6b-ef8c162368d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:12.008626 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d4832fe-4b71-4c39-8b6b-ef8c162368d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:12.009431 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d4832fe-4b71-4c39-8b6b-ef8c162368d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:12.009911 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d4832fe-4b71-4c39-8b6b-ef8c162368d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:12.270538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1d4832fe-4b71-4c39-8b6b-ef8c162368d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:12.279156 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1d4832fe-4b71-4c39-8b6b-ef8c162368d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.282933 Nov 16 19:05:12.281745 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 245/510] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:11 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:12.360564 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-684adce8-638f-45d7-a719-2f18dc95cfce req-57a4f2e5-e9e2-4eda-9d7c-b911cd2d7212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe92564-d69f-48ff-9e56-0f11bc3a5c5b", "tag": "a7c057e1-88f3-4d12-9d7d-3b797b24b605"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:05:12.362351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:05:12.362351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:05:12.371087 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-684adce8-638f-45d7-a719-2f18dc95cfce req-57a4f2e5-e9e2-4eda-9d7c-b911cd2d7212 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:12.371820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-684adce8-638f-45d7-a719-2f18dc95cfce req-57a4f2e5-e9e2-4eda-9d7c-b911cd2d7212 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:12.388530 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-684adce8-638f-45d7-a719-2f18dc95cfce req-57a4f2e5-e9e2-4eda-9d7c-b911cd2d7212 service nova] Creating event network-changed:a7c057e1-88f3-4d12-9d7d-3b797b24b605 for instance cbe92564-d69f-48ff-9e56-0f11bc3a5c5b on hv-cinder-66710 Nov 16 19:05:12.393793 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-684adce8-638f-45d7-a719-2f18dc95cfce req-57a4f2e5-e9e2-4eda-9d7c-b911cd2d7212 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038195 Nov 16 19:05:12.394379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 266/511] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:05:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:05:12.484193 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:12.484748 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:12.491212 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:12.491763 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:12.493439 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:12.493809 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:12.711716 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:12.721041 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:12.723165 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:12.724639 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c5ae9816-53aa-4543-9c09-4fed3be7e7bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.244373 Nov 16 19:05:12.725419 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 246/512] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:12 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:13.012851 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-10c035fe-2903-4f15-ac39-e3f76f673f9b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:13.013529 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-10c035fe-2903-4f15-ac39-e3f76f673f9b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:13.021900 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10c035fe-2903-4f15-ac39-e3f76f673f9b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:13.022549 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10c035fe-2903-4f15-ac39-e3f76f673f9b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:13.024220 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10c035fe-2903-4f15-ac39-e3f76f673f9b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:13.024877 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10c035fe-2903-4f15-ac39-e3f76f673f9b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:13.185837 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-10c035fe-2903-4f15-ac39-e3f76f673f9b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:13.193932 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-10c035fe-2903-4f15-ac39-e3f76f673f9b tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1319 microversion: 2.1 time: 0.188501 Nov 16 19:05:13.204046 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 267/513] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:13 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:13.297053 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f6398269-11b4-4f52-b982-f79f15e610f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:13.297771 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f6398269-11b4-4f52-b982-f79f15e610f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:13.311462 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6398269-11b4-4f52-b982-f79f15e610f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:13.312184 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6398269-11b4-4f52-b982-f79f15e610f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:13.313192 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6398269-11b4-4f52-b982-f79f15e610f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:13.313867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f6398269-11b4-4f52-b982-f79f15e610f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:13.528899 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f6398269-11b4-4f52-b982-f79f15e610f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:13.538721 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f6398269-11b4-4f52-b982-f79f15e610f8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1674 microversion: 2.1 time: 0.244365 Nov 16 19:05:13.549572 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 247/514] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:13 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:13.743637 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:13.744247 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:13.750379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:13.750825 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:13.751602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:13.752038 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:13.899833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:13.910112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:13.911764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:13.913029 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-55bd7e4d-0ec4-4b8b-8fb7-1a16f12ff98b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1806 microversion: 2.20 time: 0.173656 Nov 16 19:05:13.913630 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 268/515] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:13 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:05:14.211468 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e3834c39-7b14-4694-af9b-0003f36c2de8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:14.212152 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e3834c39-7b14-4694-af9b-0003f36c2de8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:14.218321 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e3834c39-7b14-4694-af9b-0003f36c2de8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.218321 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e3834c39-7b14-4694-af9b-0003f36c2de8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.218983 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e3834c39-7b14-4694-af9b-0003f36c2de8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.219408 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e3834c39-7b14-4694-af9b-0003f36c2de8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.354082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e3834c39-7b14-4694-af9b-0003f36c2de8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:14.361413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e3834c39-7b14-4694-af9b-0003f36c2de8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1319 microversion: 2.1 time: 0.154111 Nov 16 19:05:14.366308 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 248/516] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:14 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:14.556643 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d89163e1-1ee4-47bb-89a7-7337a8556c40 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:14.557302 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d89163e1-1ee4-47bb-89a7-7337a8556c40 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:14.563512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d89163e1-1ee4-47bb-89a7-7337a8556c40 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.563896 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d89163e1-1ee4-47bb-89a7-7337a8556c40 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.564666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d89163e1-1ee4-47bb-89a7-7337a8556c40 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.565216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d89163e1-1ee4-47bb-89a7-7337a8556c40 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.698117 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d89163e1-1ee4-47bb-89a7-7337a8556c40 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:14.705300 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d89163e1-1ee4-47bb-89a7-7337a8556c40 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1651 microversion: 2.1 time: 0.152917 Nov 16 19:05:14.705912 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 269/517] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:14 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1651 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:14.721648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-458d54db-2bb0-4072-825e-55771fcbe519 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:05:14.730131 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-458d54db-2bb0-4072-825e-55771fcbe519 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.730577 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-458d54db-2bb0-4072-825e-55771fcbe519 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.753141 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-458d54db-2bb0-4072-825e-55771fcbe519 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Going to try to start instance {{(pid=116169) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 16 19:05:14.793884 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-458d54db-2bb0-4072-825e-55771fcbe519 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action" status: 202 len: 0 microversion: 2.1 time: 0.075408 Nov 16 19:05:14.794476 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 249/518] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:05:14 2021] POST /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:05:14.802397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0e04d33b-2d73-41a1-b46d-cca4ade9013d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:14.803006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0e04d33b-2d73-41a1-b46d-cca4ade9013d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:14.809362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e04d33b-2d73-41a1-b46d-cca4ade9013d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.809819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e04d33b-2d73-41a1-b46d-cca4ade9013d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.810602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e04d33b-2d73-41a1-b46d-cca4ade9013d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.811035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e04d33b-2d73-41a1-b46d-cca4ade9013d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.932406 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:14.933091 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:14.941464 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.942038 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.942931 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:14.943411 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:14.945763 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0e04d33b-2d73-41a1-b46d-cca4ade9013d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:14.955034 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0e04d33b-2d73-41a1-b46d-cca4ade9013d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1660 microversion: 2.1 time: 0.155849 Nov 16 19:05:14.956148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 270/519] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:14 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1660 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:15.158714 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:15.167208 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:15.168870 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:15.170278 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b77cb4d2-4cc6-46da-931c-f9c1b44b5436 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1793 microversion: 2.20 time: 0.241800 Nov 16 19:05:15.171039 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 250/520] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:05:14 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1793 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:05:15.377397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d591a0dd-4fdd-49f7-88f3-cd2f7faf3cb9 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:15.378028 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d591a0dd-4fdd-49f7-88f3-cd2f7faf3cb9 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:15.384051 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d591a0dd-4fdd-49f7-88f3-cd2f7faf3cb9 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:15.384499 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d591a0dd-4fdd-49f7-88f3-cd2f7faf3cb9 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:15.385271 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d591a0dd-4fdd-49f7-88f3-cd2f7faf3cb9 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:15.385730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d591a0dd-4fdd-49f7-88f3-cd2f7faf3cb9 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:15.518335 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d591a0dd-4fdd-49f7-88f3-cd2f7faf3cb9 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:15.526164 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d591a0dd-4fdd-49f7-88f3-cd2f7faf3cb9 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1319 microversion: 2.1 time: 0.152373 Nov 16 19:05:15.526724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 271/521] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:15 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:15.973657 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7c9eacaf-c525-42ce-9887-0adcc5646f99 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:15.974173 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7c9eacaf-c525-42ce-9887-0adcc5646f99 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:15.980654 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7c9eacaf-c525-42ce-9887-0adcc5646f99 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:15.981100 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7c9eacaf-c525-42ce-9887-0adcc5646f99 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:15.981902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7c9eacaf-c525-42ce-9887-0adcc5646f99 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:15.982334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7c9eacaf-c525-42ce-9887-0adcc5646f99 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:16.340403 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7c9eacaf-c525-42ce-9887-0adcc5646f99 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:16.347724 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7c9eacaf-c525-42ce-9887-0adcc5646f99 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1660 microversion: 2.1 time: 0.377932 Nov 16 19:05:16.348289 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 251/522] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:15 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1660 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:16.543602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a58f4a92-f294-4ccd-9716-6b36a6332cf8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:16.544127 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a58f4a92-f294-4ccd-9716-6b36a6332cf8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:16.550348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a58f4a92-f294-4ccd-9716-6b36a6332cf8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:16.550793 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a58f4a92-f294-4ccd-9716-6b36a6332cf8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:16.551562 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a58f4a92-f294-4ccd-9716-6b36a6332cf8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:16.551993 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a58f4a92-f294-4ccd-9716-6b36a6332cf8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:16.679936 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a58f4a92-f294-4ccd-9716-6b36a6332cf8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:16.687028 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a58f4a92-f294-4ccd-9716-6b36a6332cf8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1319 microversion: 2.1 time: 0.147243 Nov 16 19:05:16.687586 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 272/523] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:16 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:17.134158 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-38cf6f79-4f80-43f6-a4dd-a33cbdf38963 req-94b57559-c2f5-478a-a20d-3ce007dd9f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe92564-d69f-48ff-9e56-0f11bc3a5c5b", "name": "network-vif-plugged", "status": "completed", "tag": "a7c057e1-88f3-4d12-9d7d-3b797b24b605"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:05:17.135916 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:05:17.135916 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:05:17.144660 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-38cf6f79-4f80-43f6-a4dd-a33cbdf38963 req-94b57559-c2f5-478a-a20d-3ce007dd9f88 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:17.145102 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-38cf6f79-4f80-43f6-a4dd-a33cbdf38963 req-94b57559-c2f5-478a-a20d-3ce007dd9f88 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:17.162498 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-38cf6f79-4f80-43f6-a4dd-a33cbdf38963 req-94b57559-c2f5-478a-a20d-3ce007dd9f88 service nova] Creating event network-vif-plugged:a7c057e1-88f3-4d12-9d7d-3b797b24b605 for instance cbe92564-d69f-48ff-9e56-0f11bc3a5c5b on hv-cinder-66710 Nov 16 19:05:17.168028 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-38cf6f79-4f80-43f6-a4dd-a33cbdf38963 req-94b57559-c2f5-478a-a20d-3ce007dd9f88 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038637 Nov 16 19:05:17.168794 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 252/524] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:05:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:05:17.367432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-59e6c00e-44cf-4caa-98f8-3f845a5216ab tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:17.368055 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-59e6c00e-44cf-4caa-98f8-3f845a5216ab tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:17.374432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-59e6c00e-44cf-4caa-98f8-3f845a5216ab tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:17.374875 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-59e6c00e-44cf-4caa-98f8-3f845a5216ab tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:17.375667 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-59e6c00e-44cf-4caa-98f8-3f845a5216ab tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:17.376097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-59e6c00e-44cf-4caa-98f8-3f845a5216ab tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:17.593057 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-59e6c00e-44cf-4caa-98f8-3f845a5216ab tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:17.600480 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-59e6c00e-44cf-4caa-98f8-3f845a5216ab tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1664 microversion: 2.1 time: 0.238940 Nov 16 19:05:17.601047 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 273/525] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:17 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1664 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:17.704576 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2abd677f-36c5-4ffa-a2fa-0f481bad5dc3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:17.705377 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2abd677f-36c5-4ffa-a2fa-0f481bad5dc3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:17.712100 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2abd677f-36c5-4ffa-a2fa-0f481bad5dc3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:17.712576 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2abd677f-36c5-4ffa-a2fa-0f481bad5dc3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:17.713354 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2abd677f-36c5-4ffa-a2fa-0f481bad5dc3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:17.713828 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2abd677f-36c5-4ffa-a2fa-0f481bad5dc3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:17.845724 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2abd677f-36c5-4ffa-a2fa-0f481bad5dc3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:17.853511 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2abd677f-36c5-4ffa-a2fa-0f481bad5dc3 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1319 microversion: 2.1 time: 0.153027 Nov 16 19:05:17.854092 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 253/526] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:17 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:18.870488 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f93571ee-9fec-4de7-a873-50aa89f78329 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:18.871052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f93571ee-9fec-4de7-a873-50aa89f78329 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:18.877147 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f93571ee-9fec-4de7-a873-50aa89f78329 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:18.877617 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f93571ee-9fec-4de7-a873-50aa89f78329 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:18.878383 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f93571ee-9fec-4de7-a873-50aa89f78329 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:18.878820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f93571ee-9fec-4de7-a873-50aa89f78329 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:19.008688 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f93571ee-9fec-4de7-a873-50aa89f78329 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:19.015800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f93571ee-9fec-4de7-a873-50aa89f78329 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1509 microversion: 2.1 time: 0.149570 Nov 16 19:05:19.016356 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 274/527] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:18 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:19.031661 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f2b58be2-2268-4d58-be72-ea045804f6d8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5bb904b-9079-45d9-8895-ca2c54557350", "device": "/dev/sdb"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:05:19.032853 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f2b58be2-2268-4d58-be72-ea045804f6d8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:19.039629 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f2b58be2-2268-4d58-be72-ea045804f6d8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:19.040075 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f2b58be2-2268-4d58-be72-ea045804f6d8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:19.040848 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f2b58be2-2268-4d58-be72-ea045804f6d8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:19.041277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f2b58be2-2268-4d58-be72-ea045804f6d8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:19.262552 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f2b58be2-2268-4d58-be72-ea045804f6d8 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "POST /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.234444 Nov 16 19:05:19.263279 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 254/528] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:05:19 2021] POST /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b/os-volume_attachments => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:05:43.629712 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d532ca46-f6b5-47de-8dbb-3c3ebc60fde6 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:43.630221 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d532ca46-f6b5-47de-8dbb-3c3ebc60fde6 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:43.637246 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d532ca46-f6b5-47de-8dbb-3c3ebc60fde6 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:43.637729 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d532ca46-f6b5-47de-8dbb-3c3ebc60fde6 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:43.638502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d532ca46-f6b5-47de-8dbb-3c3ebc60fde6 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:43.638936 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d532ca46-f6b5-47de-8dbb-3c3ebc60fde6 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:43.712967 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-d532ca46-f6b5-47de-8dbb-3c3ebc60fde6 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lazy-loading 'services' on Instance uuid cbe92564-d69f-48ff-9e56-0f11bc3a5c5b {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:05:43.783116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d532ca46-f6b5-47de-8dbb-3c3ebc60fde6 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b/os-volume_attachments/d5bb904b-9079-45d9-8895-ca2c54557350" status: 202 len: 0 microversion: 2.1 time: 0.157044 Nov 16 19:05:43.783709 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 275/529] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:05:43 2021] DELETE /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b/os-volume_attachments/d5bb904b-9079-45d9-8895-ca2c54557350 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:05:44.889658 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-446ba342-254a-4945-86a0-8a54ad93ade1 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:44.890286 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-446ba342-254a-4945-86a0-8a54ad93ade1 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:44.896984 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-446ba342-254a-4945-86a0-8a54ad93ade1 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:44.897428 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-446ba342-254a-4945-86a0-8a54ad93ade1 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:44.898326 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-446ba342-254a-4945-86a0-8a54ad93ade1 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:44.898751 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-446ba342-254a-4945-86a0-8a54ad93ade1 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:44.922167 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-446ba342-254a-4945-86a0-8a54ad93ade1 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:05:44.994886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-446ba342-254a-4945-86a0-8a54ad93ade1 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 204 len: 0 microversion: 2.1 time: 0.109430 Nov 16 19:05:44.995470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 255/530] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:05:44 2021] DELETE /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:05:45.004582 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-14217729-de18-49f9-a919-2b7156023a0a tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:45.005278 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-14217729-de18-49f9-a919-2b7156023a0a tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:45.012323 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14217729-de18-49f9-a919-2b7156023a0a tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:45.012787 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14217729-de18-49f9-a919-2b7156023a0a tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:45.013595 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14217729-de18-49f9-a919-2b7156023a0a tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:45.014011 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14217729-de18-49f9-a919-2b7156023a0a tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:45.144927 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-14217729-de18-49f9-a919-2b7156023a0a tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:45.152319 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-14217729-de18-49f9-a919-2b7156023a0a tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1515 microversion: 2.1 time: 0.152159 Nov 16 19:05:45.152882 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 276/531] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:44 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:46.169155 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-78ba1e0d-6dc3-4bab-a3a2-819b73476cea tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:46.169873 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-78ba1e0d-6dc3-4bab-a3a2-819b73476cea tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:46.176114 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-78ba1e0d-6dc3-4bab-a3a2-819b73476cea tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:46.176555 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-78ba1e0d-6dc3-4bab-a3a2-819b73476cea tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:46.177317 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-78ba1e0d-6dc3-4bab-a3a2-819b73476cea tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:46.177795 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-78ba1e0d-6dc3-4bab-a3a2-819b73476cea tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:46.306226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-78ba1e0d-6dc3-4bab-a3a2-819b73476cea tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:46.313332 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-78ba1e0d-6dc3-4bab-a3a2-819b73476cea tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1515 microversion: 2.1 time: 0.148200 Nov 16 19:05:46.314047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 256/532] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:46 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:47.330927 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c8d8694b-e266-432e-884b-ab689469b673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:47.331530 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c8d8694b-e266-432e-884b-ab689469b673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:47.339221 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c8d8694b-e266-432e-884b-ab689469b673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:47.339672 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c8d8694b-e266-432e-884b-ab689469b673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:47.340456 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c8d8694b-e266-432e-884b-ab689469b673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:47.340891 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c8d8694b-e266-432e-884b-ab689469b673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:47.471362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c8d8694b-e266-432e-884b-ab689469b673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7dbeb8d8c143bd97ff13e0be4b4fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e9cbea1c0e436b8c518eaa18d7b74c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:05:47.478606 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c8d8694b-e266-432e-884b-ab689469b673 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 200 len: 1515 microversion: 2.1 time: 0.151340 Nov 16 19:05:47.479172 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 277/533] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:47 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:05:47.622197 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-50031c13-bc62-4786-b456-ea289379dd13 req-ba47ae18-6a56-4c9e-85cf-ca8f5731433e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe92564-d69f-48ff-9e56-0f11bc3a5c5b", "name": "network-vif-deleted", "tag": "a7c057e1-88f3-4d12-9d7d-3b797b24b605"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:05:47.623689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:05:47.623689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:05:47.631527 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-50031c13-bc62-4786-b456-ea289379dd13 req-ba47ae18-6a56-4c9e-85cf-ca8f5731433e service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:47.632675 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-50031c13-bc62-4786-b456-ea289379dd13 req-ba47ae18-6a56-4c9e-85cf-ca8f5731433e service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:47.643805 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-50031c13-bc62-4786-b456-ea289379dd13 req-ba47ae18-6a56-4c9e-85cf-ca8f5731433e service nova] Creating event network-vif-deleted:a7c057e1-88f3-4d12-9d7d-3b797b24b605 for instance cbe92564-d69f-48ff-9e56-0f11bc3a5c5b on hv-cinder-66710 Nov 16 19:05:47.649856 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-50031c13-bc62-4786-b456-ea289379dd13 req-ba47ae18-6a56-4c9e-85cf-ca8f5731433e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031107 Nov 16 19:05:47.650442 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 257/534] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:05:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:05:48.496423 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:05:48.497033 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] [instance: cbe92564-d69f-48ff-9e56-0f11bc3a5c5b] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:05:48.503280 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:48.503720 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:48.504494 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:05:48.504917 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:05:48.517787 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] HTTP exception thrown: Instance cbe92564-d69f-48ff-9e56-0f11bc3a5c5b could not be found. Nov 16 19:05:48.518344 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] Returning 404 to user: Instance cbe92564-d69f-48ff-9e56-0f11bc3a5c5b could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:05:48.519148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-312db1fd-cf36-4149-9171-2f227ef99054 tempest-VolumesSnapshotTestJSON-2017893359 tempest-VolumesSnapshotTestJSON-2017893359-project] 10.222.0.46 "GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b" status: 404 len: 111 microversion: 2.1 time: 0.026393 Nov 16 19:05:48.519647 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 278/535] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:05:48 2021] GET /compute/v2.1/servers/cbe92564-d69f-48ff-9e56-0f11bc3a5c5b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:05:54.083030 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:05:54.083470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: Tue Nov 16 19:05:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:06:06.619325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-99e1219f-f4c6-4e91-a886-a4004d9c278b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:06.619966 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-99e1219f-f4c6-4e91-a886-a4004d9c278b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:06.625832 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99e1219f-f4c6-4e91-a886-a4004d9c278b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:06.626274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99e1219f-f4c6-4e91-a886-a4004d9c278b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:06.627041 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99e1219f-f4c6-4e91-a886-a4004d9c278b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:06.627470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99e1219f-f4c6-4e91-a886-a4004d9c278b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:06.658838 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-99e1219f-f4c6-4e91-a886-a4004d9c278b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments/b40b3380-c96b-4a9f-b045-032a551645c7" status: 200 len: 194 microversion: 2.20 time: 0.044893 Nov 16 19:06:06.659404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 258/536] 10.222.0.46 () {60 vars in 1453 bytes} [Tue Nov 16 19:06:06 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments/b40b3380-c96b-4a9f-b045-032a551645c7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:06.717931 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cb619878-882a-4951-a3f0-a0f442cdc554 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:06.718399 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cb619878-882a-4951-a3f0-a0f442cdc554 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:06.724109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb619878-882a-4951-a3f0-a0f442cdc554 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:06.724549 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb619878-882a-4951-a3f0-a0f442cdc554 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:06.725336 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb619878-882a-4951-a3f0-a0f442cdc554 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:06.725788 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb619878-882a-4951-a3f0-a0f442cdc554 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:06.801935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-cb619878-882a-4951-a3f0-a0f442cdc554 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lazy-loading 'services' on Instance uuid b188c4dd-b4cc-4a02-9ea4-901009c68534 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:06:06.876267 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cb619878-882a-4951-a3f0-a0f442cdc554 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments/b40b3380-c96b-4a9f-b045-032a551645c7" status: 202 len: 0 microversion: 2.20 time: 0.161909 Nov 16 19:06:06.876888 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 279/537] 10.222.0.46 () {60 vars in 1456 bytes} [Tue Nov 16 19:06:06 2021] DELETE /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments/b40b3380-c96b-4a9f-b045-032a551645c7 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:06:06.885890 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6349345c-cfdc-40d2-88fb-778a0b9b3de0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:06.886880 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6349345c-cfdc-40d2-88fb-778a0b9b3de0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:06.893043 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6349345c-cfdc-40d2-88fb-778a0b9b3de0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:06.893665 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6349345c-cfdc-40d2-88fb-778a0b9b3de0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:06.894693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6349345c-cfdc-40d2-88fb-778a0b9b3de0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:06.895190 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6349345c-cfdc-40d2-88fb-778a0b9b3de0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:06.925458 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6349345c-cfdc-40d2-88fb-778a0b9b3de0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043510 Nov 16 19:06:06.926031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 259/538] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 19:06:06 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:07.938404 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-96ec294c-0642-4d5a-b708-dc5952e74b1c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:07.939455 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-96ec294c-0642-4d5a-b708-dc5952e74b1c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:07.946030 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96ec294c-0642-4d5a-b708-dc5952e74b1c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:07.946478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96ec294c-0642-4d5a-b708-dc5952e74b1c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:07.947250 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96ec294c-0642-4d5a-b708-dc5952e74b1c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:07.947682 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96ec294c-0642-4d5a-b708-dc5952e74b1c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:07.978103 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-96ec294c-0642-4d5a-b708-dc5952e74b1c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044313 Nov 16 19:06:07.978668 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 280/539] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 19:06:07 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:08.034237 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ef0e375e-3adf-4d62-8e10-d2ce28a9e2d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:08.034725 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ef0e375e-3adf-4d62-8e10-d2ce28a9e2d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:08.040751 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ef0e375e-3adf-4d62-8e10-d2ce28a9e2d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:08.041190 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ef0e375e-3adf-4d62-8e10-d2ce28a9e2d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:08.041984 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ef0e375e-3adf-4d62-8e10-d2ce28a9e2d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:08.042410 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ef0e375e-3adf-4d62-8e10-d2ce28a9e2d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:08.066158 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ef0e375e-3adf-4d62-8e10-d2ce28a9e2d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:06:08.137395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ef0e375e-3adf-4d62-8e10-d2ce28a9e2d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 204 len: 0 microversion: 2.20 time: 0.106439 Nov 16 19:06:08.141917 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 260/540] 10.222.0.46 () {60 vars in 1279 bytes} [Tue Nov 16 19:06:08 2021] DELETE /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 19:06:08.149810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:08.150632 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:08.156599 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:08.156972 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:08.157781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:08.158217 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:08.287716 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:08.295362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:08.296873 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:08.298066 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6e3bd13f-956e-4ab9-b810-67e606be292b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.151971 Nov 16 19:06:08.298621 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 281/541] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:08 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:09.316521 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:09.317142 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:09.323977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:09.324421 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:09.325186 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:09.325653 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:09.458939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:09.467330 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:09.468826 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:09.470018 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-206c9462-ccda-48e8-955c-e6fba9602d47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1721 microversion: 2.20 time: 0.157593 Nov 16 19:06:09.470573 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 261/542] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:09 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:10.489882 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:10.490636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:10.499200 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:10.499807 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:10.501065 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:10.501580 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:10.570514 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:10.578730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:10.580208 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:10.581414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a2fb49d8-fe32-4020-b82d-7087b9e649a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 200 len: 1653 microversion: 2.20 time: 0.096175 Nov 16 19:06:10.582100 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 282/543] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:10 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 1653 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:10.764693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-2a8c1d6b-15f3-47e3-aff1-5ce3f2feb3fb req-71e93ad3-6c9c-4a26-adac-245696717cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b188c4dd-b4cc-4a02-9ea4-901009c68534", "name": "network-vif-deleted", "tag": "3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:10.767075 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:06:10.767075 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:06:10.777731 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-2a8c1d6b-15f3-47e3-aff1-5ce3f2feb3fb req-71e93ad3-6c9c-4a26-adac-245696717cd7 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:10.778207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-2a8c1d6b-15f3-47e3-aff1-5ce3f2feb3fb req-71e93ad3-6c9c-4a26-adac-245696717cd7 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:10.790395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-2a8c1d6b-15f3-47e3-aff1-5ce3f2feb3fb req-71e93ad3-6c9c-4a26-adac-245696717cd7 service nova] Creating event network-vif-deleted:3c2c4e6b-17cd-4a03-8b15-1a156a3f00ae for instance b188c4dd-b4cc-4a02-9ea4-901009c68534 on hv-cinder-66710 Nov 16 19:06:10.796154 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-2a8c1d6b-15f3-47e3-aff1-5ce3f2feb3fb req-71e93ad3-6c9c-4a26-adac-245696717cd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034870 Nov 16 19:06:10.797181 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 262/544] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:06:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:06:11.600529 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:11.602133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:11.609936 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:11.610451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:11.611800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:11.612508 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:11.639974 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] HTTP exception thrown: Instance b188c4dd-b4cc-4a02-9ea4-901009c68534 could not be found. Nov 16 19:06:11.641025 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Returning 404 to user: Instance b188c4dd-b4cc-4a02-9ea4-901009c68534 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:06:11.641984 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c30cd5f9-8e43-4133-8f82-2192cc9404d0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 404 len: 111 microversion: 2.20 time: 0.045529 Nov 16 19:06:11.643333 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 283/545] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:11 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 16 19:06:11.652977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-13b51d3f-31d1-420f-884d-6735ad0ba49a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '.version_select at 0x7ffa5776de50>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:11.675020 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-13b51d3f-31d1-420f-884d-6735ad0ba49a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-186012312" status: 204 len: 0 microversion: 2.20 time: 0.026372 Nov 16 19:06:11.675919 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 263/546] 10.222.0.46 () {60 vars in 1258 bytes} [Tue Nov 16 19:06:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-186012312 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 19:06:12.508546 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fe46d66a-0aad-442a-8baf-b78700667548 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'create', calling method: .version_select at 0x7ffa56c7ef70>, body: {"keypair": {"name": "tempest-keypair-1037811477"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:12.521710 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-fe46d66a-0aad-442a-8baf-b78700667548 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:06:12.525433 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-fe46d66a-0aad-442a-8baf-b78700667548 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for user bc21495c8b60405194f1a6ea2de3e9e7 and project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:06:12.887984 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-fe46d66a-0aad-442a-8baf-b78700667548 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:06:12.891575 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-fe46d66a-0aad-442a-8baf-b78700667548 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for user bc21495c8b60405194f1a6ea2de3e9e7 and project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:06:12.903770 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fe46d66a-0aad-442a-8baf-b78700667548 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.399708 Nov 16 19:06:12.904359 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 284/547] 10.222.0.46 () {62 vars in 1198 bytes} [Tue Nov 16 19:06:12 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 401 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 16 19:06:14.142129 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1267413500", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56c01722-be30-4639-862d-514173b6757f"}], "security_groups": [{"name": "tempest-securitygroup--73525442"}], "key_name": "tempest-keypair-1037811477", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:14.245800 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] validate_networks() for [('56c01722-be30-4639-862d-514173b6757f', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:06:14.605767 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:06:14.606188 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:06:14.606659 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:06:14.607066 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:06:14.607472 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:06:14.616560 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:14.617009 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:14.617845 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:14.618276 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:14.634214 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:06:14.638024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Getting quotas for user bc21495c8b60405194f1a6ea2de3e9e7 and project b7b9aa6405c640ff81bc02db314b5e9c. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:06:14.648382 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:06:14.650766 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:06:14.698595 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3b22661b-df94-4f7a-a0a1-51bef79805ed tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.560547 Nov 16 19:06:14.699503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 264/548] 10.222.0.46 () {62 vars in 1187 bytes} [Tue Nov 16 19:06:14 2021] POST /compute/v2.1/servers => generated 400 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 16 19:06:14.709303 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cc7ffc5c-72e2-46d1-840b-8ca80900e4a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:14.710441 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cc7ffc5c-72e2-46d1-840b-8ca80900e4a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:14.766009 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cc7ffc5c-72e2-46d1-840b-8ca80900e4a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:14.773052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cc7ffc5c-72e2-46d1-840b-8ca80900e4a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:14.774703 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cc7ffc5c-72e2-46d1-840b-8ca80900e4a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:14.775797 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cc7ffc5c-72e2-46d1-840b-8ca80900e4a4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1282 microversion: 2.20 time: 0.070557 Nov 16 19:06:14.776344 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 285/549] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:14 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:15.793454 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:15.794085 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:15.800288 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:15.800810 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:15.801611 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:15.802079 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:15.871221 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:15.879120 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:15.880853 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:15.881956 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fbc80455-64f5-405a-843a-05629a36d228 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1340 microversion: 2.20 time: 0.092793 Nov 16 19:06:15.882512 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 265/550] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:15 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:16.900089 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:16.900793 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:16.907422 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:16.907865 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:16.908643 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:16.909072 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:17.042489 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:17.050649 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:17.052126 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:17.053226 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-35076374-b094-4022-b7e4-f6ad4be9975f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1406 microversion: 2.20 time: 0.156850 Nov 16 19:06:17.053813 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 286/551] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:16 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:17.119213 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-57fff724-a210-453f-b64f-a719f3342b0c req-19bdca10-2fc2-4b10-ad86-6e4e4ba32bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4", "tag": "5a94a757-e4b7-461b-a346-267538387bdf"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:17.121864 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:06:17.121864 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:06:17.129247 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-57fff724-a210-453f-b64f-a719f3342b0c req-19bdca10-2fc2-4b10-ad86-6e4e4ba32bf3 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:17.129739 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-57fff724-a210-453f-b64f-a719f3342b0c req-19bdca10-2fc2-4b10-ad86-6e4e4ba32bf3 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:17.145304 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-57fff724-a210-453f-b64f-a719f3342b0c req-19bdca10-2fc2-4b10-ad86-6e4e4ba32bf3 service nova] Creating event network-changed:5a94a757-e4b7-461b-a346-267538387bdf for instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 on hv-cinder-66710 Nov 16 19:06:17.151726 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-57fff724-a210-453f-b64f-a719f3342b0c req-19bdca10-2fc2-4b10-ad86-6e4e4ba32bf3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036719 Nov 16 19:06:17.152389 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 266/552] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:06:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:06:18.071240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:18.071838 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:18.078060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:18.078515 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:18.079284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:18.079714 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:18.205969 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:18.214076 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:18.215564 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:18.216646 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bfc704f8-85a4-42cf-b5e3-49bd9e1eb45e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1406 microversion: 2.20 time: 0.149110 Nov 16 19:06:18.217199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 287/553] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:18 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:19.236538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:19.237230 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:19.243704 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:19.244146 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:19.244915 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:19.245346 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:19.526879 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:19.534599 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:19.536076 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:19.537191 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-73ef9968-bd06-41b0-89f9-987029febce3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1406 microversion: 2.20 time: 0.306087 Nov 16 19:06:19.538398 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 267/554] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:19 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:20.554854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:20.555392 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:20.561754 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:20.562204 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:20.562978 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:20.563416 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:20.748509 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:20.757200 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:20.758733 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:20.759869 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4982914c-193a-4bfe-81e6-3a37b41534a9 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1406 microversion: 2.20 time: 0.208800 Nov 16 19:06:20.763983 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 288/555] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:20 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:20.808133 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0bc8afd3-66d7-4281-9bdf-7c2814150bba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:20.808984 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0bc8afd3-66d7-4281-9bdf-7c2814150bba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:20.815098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bc8afd3-66d7-4281-9bdf-7c2814150bba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:20.815539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bc8afd3-66d7-4281-9bdf-7c2814150bba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:20.816302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bc8afd3-66d7-4281-9bdf-7c2814150bba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:20.816732 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bc8afd3-66d7-4281-9bdf-7c2814150bba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:20.844405 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0bc8afd3-66d7-4281-9bdf-7c2814150bba tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039994 Nov 16 19:06:20.844940 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 268/556] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:06:20 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:20.899505 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-92fb386a-ce17-4424-b506-6f2e233aa0db tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:20.900000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-92fb386a-ce17-4424-b506-6f2e233aa0db tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:20.905740 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92fb386a-ce17-4424-b506-6f2e233aa0db tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:20.906198 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92fb386a-ce17-4424-b506-6f2e233aa0db tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:20.906965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92fb386a-ce17-4424-b506-6f2e233aa0db tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:20.907400 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92fb386a-ce17-4424-b506-6f2e233aa0db tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:20.931425 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-92fb386a-ce17-4424-b506-6f2e233aa0db tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:06:21.001432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-92fb386a-ce17-4424-b506-6f2e233aa0db tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 204 len: 0 microversion: 2.1 time: 0.105201 Nov 16 19:06:21.002317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 289/557] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:06:20 2021] DELETE /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:06:21.011039 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4b9f2e9c-2c14-4c49-bc97-e26d2c75aaf2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:21.011628 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4b9f2e9c-2c14-4c49-bc97-e26d2c75aaf2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:21.017407 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b9f2e9c-2c14-4c49-bc97-e26d2c75aaf2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:21.017892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b9f2e9c-2c14-4c49-bc97-e26d2c75aaf2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:21.018657 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b9f2e9c-2c14-4c49-bc97-e26d2c75aaf2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:21.019087 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b9f2e9c-2c14-4c49-bc97-e26d2c75aaf2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:21.148130 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4b9f2e9c-2c14-4c49-bc97-e26d2c75aaf2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:21.155353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4b9f2e9c-2c14-4c49-bc97-e26d2c75aaf2 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1670 microversion: 2.1 time: 0.147922 Nov 16 19:06:21.155906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 269/558] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:21 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:21.400483 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-b96381ce-ada6-44d3-9036-fe79537329b4 req-9006c309-2807-417b-962d-532dff6a46cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4", "name": "network-vif-plugged", "status": "completed", "tag": "5a94a757-e4b7-461b-a346-267538387bdf"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:21.402082 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:06:21.402082 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:06:21.409025 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-b96381ce-ada6-44d3-9036-fe79537329b4 req-9006c309-2807-417b-962d-532dff6a46cb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:21.409457 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-b96381ce-ada6-44d3-9036-fe79537329b4 req-9006c309-2807-417b-962d-532dff6a46cb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:21.421917 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-b96381ce-ada6-44d3-9036-fe79537329b4 req-9006c309-2807-417b-962d-532dff6a46cb service nova] Creating event network-vif-plugged:5a94a757-e4b7-461b-a346-267538387bdf for instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 on hv-cinder-66710 Nov 16 19:06:21.426750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-b96381ce-ada6-44d3-9036-fe79537329b4 req-9006c309-2807-417b-962d-532dff6a46cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030525 Nov 16 19:06:21.427645 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 290/559] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:06:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:06:21.777344 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:21.778008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:21.783919 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:21.784384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:21.785175 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:21.785624 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:21.911745 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:21.919894 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:21.921376 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:21.922492 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-54886773-5007-41c2-9b0b-7cf965c59a84 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1406 microversion: 2.20 time: 0.148856 Nov 16 19:06:21.923240 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 270/560] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:21 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:22.172442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-af1bf205-c350-4d30-8c56-6b82e1fc5509 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:22.173072 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-af1bf205-c350-4d30-8c56-6b82e1fc5509 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:22.180065 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af1bf205-c350-4d30-8c56-6b82e1fc5509 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:22.180506 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af1bf205-c350-4d30-8c56-6b82e1fc5509 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:22.181262 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af1bf205-c350-4d30-8c56-6b82e1fc5509 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:22.181718 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af1bf205-c350-4d30-8c56-6b82e1fc5509 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:22.309439 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-af1bf205-c350-4d30-8c56-6b82e1fc5509 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:22.316664 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-af1bf205-c350-4d30-8c56-6b82e1fc5509 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1670 microversion: 2.1 time: 0.148216 Nov 16 19:06:22.317223 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 291/561] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:22 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:22.940272 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:22.940849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:22.947571 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:22.948016 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:22.948781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:22.949215 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:23.079551 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:23.087199 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:23.088686 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:23.089850 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d805e9ba-405a-4bc8-a4b6-e1c606be91c5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1596 microversion: 2.20 time: 0.153285 Nov 16 19:06:23.090410 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 271/562] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:06:22 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1596 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:23.106704 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1bd67f84-fe5b-4542-9900-048a0a0d7296 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:23.107185 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1bd67f84-fe5b-4542-9900-048a0a0d7296 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:23.112860 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bd67f84-fe5b-4542-9900-048a0a0d7296 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:23.113300 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bd67f84-fe5b-4542-9900-048a0a0d7296 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:23.114101 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bd67f84-fe5b-4542-9900-048a0a0d7296 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:23.114529 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bd67f84-fe5b-4542-9900-048a0a0d7296 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:23.190380 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1bd67f84-fe5b-4542-9900-048a0a0d7296 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087239 Nov 16 19:06:23.190953 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 292/563] 10.222.0.46 () {60 vars in 1315 bytes} [Tue Nov 16 19:06:23 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:23.333631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-83a6a291-79ee-40a4-9416-770d22071a20 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:23.334236 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-83a6a291-79ee-40a4-9416-770d22071a20 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:23.340031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-83a6a291-79ee-40a4-9416-770d22071a20 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:23.340474 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-83a6a291-79ee-40a4-9416-770d22071a20 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:23.344507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-83a6a291-79ee-40a4-9416-770d22071a20 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:23.344507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-83a6a291-79ee-40a4-9416-770d22071a20 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:23.532548 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-83a6a291-79ee-40a4-9416-770d22071a20 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:23.540512 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-83a6a291-79ee-40a4-9416-770d22071a20 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1670 microversion: 2.1 time: 0.210442 Nov 16 19:06:23.551054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 272/564] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:23 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1670 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:24.106916 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-30e33ed8-d874-4c5c-b658-62c57cff851f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:24.107990 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-30e33ed8-d874-4c5c-b658-62c57cff851f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:24.110349 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-8e3075ce-5f43-4b2e-9d4b-3949961d6bc5 req-6467d484-7717-40bf-bba7-7c9d04bbdaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4", "tag": "5a94a757-e4b7-461b-a346-267538387bdf"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:24.112679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:06:24.112679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:06:24.114449 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30e33ed8-d874-4c5c-b658-62c57cff851f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:24.114899 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30e33ed8-d874-4c5c-b658-62c57cff851f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:24.116451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30e33ed8-d874-4c5c-b658-62c57cff851f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:24.117094 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30e33ed8-d874-4c5c-b658-62c57cff851f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:24.122698 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-8e3075ce-5f43-4b2e-9d4b-3949961d6bc5 req-6467d484-7717-40bf-bba7-7c9d04bbdaa0 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:24.123338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-8e3075ce-5f43-4b2e-9d4b-3949961d6bc5 req-6467d484-7717-40bf-bba7-7c9d04bbdaa0 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:24.139181 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-8e3075ce-5f43-4b2e-9d4b-3949961d6bc5 req-6467d484-7717-40bf-bba7-7c9d04bbdaa0 service nova] Creating event network-changed:5a94a757-e4b7-461b-a346-267538387bdf for instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 on hv-cinder-66710 Nov 16 19:06:24.146214 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-8e3075ce-5f43-4b2e-9d4b-3949961d6bc5 req-6467d484-7717-40bf-bba7-7c9d04bbdaa0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040445 Nov 16 19:06:24.162301 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 273/565] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:06:24.191291 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-30e33ed8-d874-4c5c-b658-62c57cff851f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.088194 Nov 16 19:06:24.194455 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 293/566] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:24 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:06:24.377027 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-2e1b3efc-f59c-42e9-ad82-1f8a35394f35 req-cf894ef5-68d0-4b95-a1fd-1fce77404f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7190b8e5-4def-4b46-bf21-dae43664c0ad", "name": "network-vif-deleted", "tag": "e5571c38-77b9-4106-b9fd-2ba0f22a1929"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:24.378585 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:06:24.378585 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:06:24.389795 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-2e1b3efc-f59c-42e9-ad82-1f8a35394f35 req-cf894ef5-68d0-4b95-a1fd-1fce77404f73 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:24.390242 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-2e1b3efc-f59c-42e9-ad82-1f8a35394f35 req-cf894ef5-68d0-4b95-a1fd-1fce77404f73 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:24.406406 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-2e1b3efc-f59c-42e9-ad82-1f8a35394f35 req-cf894ef5-68d0-4b95-a1fd-1fce77404f73 service nova] Creating event network-vif-deleted:e5571c38-77b9-4106-b9fd-2ba0f22a1929 for instance 7190b8e5-4def-4b46-bf21-dae43664c0ad on hv-cinder-66710 Nov 16 19:06:24.423024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-2e1b3efc-f59c-42e9-ad82-1f8a35394f35 req-cf894ef5-68d0-4b95-a1fd-1fce77404f73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043860 Nov 16 19:06:24.423695 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 274/567] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:06:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:06:24.559895 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:24.560812 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:24.584097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:24.586119 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:24.586967 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:24.587418 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:24.649116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:24.649894 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:24.650509 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lazy-loading 'fault' on Instance uuid 7190b8e5-4def-4b46-bf21-dae43664c0ad {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:06:24.695634 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:24.703281 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7a37bef6-aa8d-4c13-bb45-3b679c83a46e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 200 len: 1328 microversion: 2.1 time: 0.147848 Nov 16 19:06:24.704405 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 294/568] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:24 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 1328 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:25.203751 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-57b79045-1e93-4538-aa28-b863442075b1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:25.204787 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-57b79045-1e93-4538-aa28-b863442075b1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:25.212112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-57b79045-1e93-4538-aa28-b863442075b1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:25.212559 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-57b79045-1e93-4538-aa28-b863442075b1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:25.213333 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-57b79045-1e93-4538-aa28-b863442075b1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:25.213791 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-57b79045-1e93-4538-aa28-b863442075b1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:25.273300 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-57b79045-1e93-4538-aa28-b863442075b1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.073902 Nov 16 19:06:25.273963 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 275/569] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:25 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:25.722995 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:25.723595 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:25.730735 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:25.731183 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:25.731997 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:25.732425 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:25.746902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] HTTP exception thrown: Instance 7190b8e5-4def-4b46-bf21-dae43664c0ad could not be found. Nov 16 19:06:25.747489 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Returning 404 to user: Instance 7190b8e5-4def-4b46-bf21-dae43664c0ad could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:06:25.748346 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-266297c5-307d-4b36-980f-c07fee3a61c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 404 len: 111 microversion: 2.1 time: 0.029373 Nov 16 19:06:25.748893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 295/570] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:25 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:06:25.757834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c7525a86-86b7-4536-9b2c-8354d034dd3d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '.version_select at 0x7ffa56ccab80>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:25.776297 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c7525a86-86b7-4536-9b2c-8354d034dd3d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135324023" status: 202 len: 0 microversion: 2.1 time: 0.022603 Nov 16 19:06:25.776866 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 276/571] 10.222.0.46 () {58 vars in 1220 bytes} [Tue Nov 16 19:06:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1135324023 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:26.284668 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6943b8b1-c1ee-4bfc-b635-fbcef19df69f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:26.285608 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6943b8b1-c1ee-4bfc-b635-fbcef19df69f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:26.292359 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6943b8b1-c1ee-4bfc-b635-fbcef19df69f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:26.292805 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6943b8b1-c1ee-4bfc-b635-fbcef19df69f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:26.293606 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6943b8b1-c1ee-4bfc-b635-fbcef19df69f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:26.294074 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6943b8b1-c1ee-4bfc-b635-fbcef19df69f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:26.356268 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6943b8b1-c1ee-4bfc-b635-fbcef19df69f tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.075608 Nov 16 19:06:26.357225 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 296/572] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:26 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:26.498184 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9bf54c33-a9b5-4a19-b78b-b36e8e60521b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'create', calling method: .version_select at 0x7ffa56d77040>, body: {"keypair": {"name": "tempest-keypair-781586712"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:26.512834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-9bf54c33-a9b5-4a19-b78b-b36e8e60521b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for project 836db18eadf842ce90dda0a1221006ff. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:06:26.516674 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-9bf54c33-a9b5-4a19-b78b-b36e8e60521b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for user 047420b1d0b84633af129ecb0ac468ab and project 836db18eadf842ce90dda0a1221006ff. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:06:26.640160 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-9bf54c33-a9b5-4a19-b78b-b36e8e60521b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for project 836db18eadf842ce90dda0a1221006ff. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:06:26.644074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-9bf54c33-a9b5-4a19-b78b-b36e8e60521b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for user 047420b1d0b84633af129ecb0ac468ab and project 836db18eadf842ce90dda0a1221006ff. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:06:26.657149 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9bf54c33-a9b5-4a19-b78b-b36e8e60521b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.261509 Nov 16 19:06:26.658022 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 277/573] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 19:06:26 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:27.368096 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1608f039-1d91-41aa-abcb-a3a23c62fa6e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:27.369202 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1608f039-1d91-41aa-abcb-a3a23c62fa6e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:27.376174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1608f039-1d91-41aa-abcb-a3a23c62fa6e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:27.376688 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1608f039-1d91-41aa-abcb-a3a23c62fa6e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:27.377669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1608f039-1d91-41aa-abcb-a3a23c62fa6e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:27.378104 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1608f039-1d91-41aa-abcb-a3a23c62fa6e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:27.441280 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1608f039-1d91-41aa-abcb-a3a23c62fa6e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.077205 Nov 16 19:06:27.442247 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 297/574] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:27 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:28.033428 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1454885225", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88bf2e43-28ce-4261-97c8-fd704bf50e7b"}], "security_groups": [{"name": "tempest-securitygroup--805011269"}], "key_name": "tempest-keypair-781586712", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:28.135017 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] validate_networks() for [('88bf2e43-28ce-4261-97c8-fd704bf50e7b', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:06:28.452937 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e154cf93-db29-43dc-8a10-188c11a1ec46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:28.453972 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e154cf93-db29-43dc-8a10-188c11a1ec46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:28.461458 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e154cf93-db29-43dc-8a10-188c11a1ec46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:28.461934 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e154cf93-db29-43dc-8a10-188c11a1ec46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:28.462719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e154cf93-db29-43dc-8a10-188c11a1ec46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:28.463151 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e154cf93-db29-43dc-8a10-188c11a1ec46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:28.520380 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e154cf93-db29-43dc-8a10-188c11a1ec46 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.071183 Nov 16 19:06:28.523960 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 298/575] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:28 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:06:28.539226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:06:28.539664 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:06:28.540125 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:06:28.540580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:06:28.541010 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:06:28.549897 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:28.550332 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:28.551127 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:28.551552 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:28.567315 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for project 836db18eadf842ce90dda0a1221006ff. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:06:28.571087 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Getting quotas for user 047420b1d0b84633af129ecb0ac468ab and project 836db18eadf842ce90dda0a1221006ff. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:06:28.581303 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:06:28.583732 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:06:28.632316 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1d267cdf-e3d9-4044-a3e9-10a35f0c0410 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602235 Nov 16 19:06:28.638447 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 278/576] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:06:28 2021] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:06:28.643366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-35b34702-190f-4d7b-ac9e-1d5ba3cfcdce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:28.644062 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-35b34702-190f-4d7b-ac9e-1d5ba3cfcdce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:28.700160 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-35b34702-190f-4d7b-ac9e-1d5ba3cfcdce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:28.706748 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-35b34702-190f-4d7b-ac9e-1d5ba3cfcdce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1237 microversion: 2.1 time: 0.067325 Nov 16 19:06:28.707400 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 299/577] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:28 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:29.531532 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fc8b8e50-f80b-4e0e-97c1-db9bcf4ae6e0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:29.532538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fc8b8e50-f80b-4e0e-97c1-db9bcf4ae6e0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:29.538708 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fc8b8e50-f80b-4e0e-97c1-db9bcf4ae6e0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:29.539144 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fc8b8e50-f80b-4e0e-97c1-db9bcf4ae6e0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:29.539901 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fc8b8e50-f80b-4e0e-97c1-db9bcf4ae6e0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:29.540327 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fc8b8e50-f80b-4e0e-97c1-db9bcf4ae6e0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:29.597081 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fc8b8e50-f80b-4e0e-97c1-db9bcf4ae6e0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.069240 Nov 16 19:06:29.597844 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 279/578] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:29 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:29.724403 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eabd31f3-a2d8-4620-b18c-ede6ce1e8c91 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:29.725004 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eabd31f3-a2d8-4620-b18c-ede6ce1e8c91 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:29.732312 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eabd31f3-a2d8-4620-b18c-ede6ce1e8c91 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:29.733065 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eabd31f3-a2d8-4620-b18c-ede6ce1e8c91 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:29.734097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eabd31f3-a2d8-4620-b18c-ede6ce1e8c91 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:29.734712 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eabd31f3-a2d8-4620-b18c-ede6ce1e8c91 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:29.804216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eabd31f3-a2d8-4620-b18c-ede6ce1e8c91 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:29.813245 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eabd31f3-a2d8-4620-b18c-ede6ce1e8c91 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1297 microversion: 2.1 time: 0.092631 Nov 16 19:06:29.814170 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 300/579] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:29 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:30.608446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-865fc9d1-069e-4f9a-8d96-be381efbff91 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:30.609798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-865fc9d1-069e-4f9a-8d96-be381efbff91 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:30.616699 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-865fc9d1-069e-4f9a-8d96-be381efbff91 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:30.617143 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-865fc9d1-069e-4f9a-8d96-be381efbff91 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:30.617943 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-865fc9d1-069e-4f9a-8d96-be381efbff91 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:30.618375 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-865fc9d1-069e-4f9a-8d96-be381efbff91 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:30.675889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-865fc9d1-069e-4f9a-8d96-be381efbff91 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.071336 Nov 16 19:06:30.679151 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 280/580] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:30 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:30.832154 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2ae60386-b5c5-47db-9434-cd904dc992dd tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:30.832824 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2ae60386-b5c5-47db-9434-cd904dc992dd tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:30.843339 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae60386-b5c5-47db-9434-cd904dc992dd tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:30.844159 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae60386-b5c5-47db-9434-cd904dc992dd tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:30.845164 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae60386-b5c5-47db-9434-cd904dc992dd tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:30.845818 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae60386-b5c5-47db-9434-cd904dc992dd tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:30.988237 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2ae60386-b5c5-47db-9434-cd904dc992dd tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:30.996538 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2ae60386-b5c5-47db-9434-cd904dc992dd tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1362 microversion: 2.1 time: 0.167887 Nov 16 19:06:30.997113 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 301/581] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:30 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:06:31.245414 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-9aca19c3-0620-4eb9-a90d-9ed457615145 req-f2920016-d827-489d-8719-581061486a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa66316-7216-4224-92a2-7280db37d232", "tag": "2e45e72d-543c-4ccf-ae9c-db23235939c9"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:31.247177 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:06:31.247177 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:06:31.262297 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-9aca19c3-0620-4eb9-a90d-9ed457615145 req-f2920016-d827-489d-8719-581061486a61 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:31.262737 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-9aca19c3-0620-4eb9-a90d-9ed457615145 req-f2920016-d827-489d-8719-581061486a61 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:31.276284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-9aca19c3-0620-4eb9-a90d-9ed457615145 req-f2920016-d827-489d-8719-581061486a61 service nova] Creating event network-changed:2e45e72d-543c-4ccf-ae9c-db23235939c9 for instance 9fa66316-7216-4224-92a2-7280db37d232 on hv-cinder-66710 Nov 16 19:06:31.281643 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-9aca19c3-0620-4eb9-a90d-9ed457615145 req-f2920016-d827-489d-8719-581061486a61 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042276 Nov 16 19:06:31.282770 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 281/582] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:06:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:06:31.688762 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bf664dfe-2edf-4aa3-97b9-250612529f39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:31.690594 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bf664dfe-2edf-4aa3-97b9-250612529f39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:31.699083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf664dfe-2edf-4aa3-97b9-250612529f39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:31.699528 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf664dfe-2edf-4aa3-97b9-250612529f39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:31.700311 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf664dfe-2edf-4aa3-97b9-250612529f39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:31.700744 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf664dfe-2edf-4aa3-97b9-250612529f39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:31.768158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bf664dfe-2edf-4aa3-97b9-250612529f39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.084824 Nov 16 19:06:31.768817 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 302/583] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:31 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:32.014319 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3eaf5624-97eb-45e2-84d9-5291b28c95c7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:32.015110 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3eaf5624-97eb-45e2-84d9-5291b28c95c7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:32.022442 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3eaf5624-97eb-45e2-84d9-5291b28c95c7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:32.022902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3eaf5624-97eb-45e2-84d9-5291b28c95c7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:32.023692 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3eaf5624-97eb-45e2-84d9-5291b28c95c7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:32.024128 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3eaf5624-97eb-45e2-84d9-5291b28c95c7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:32.234939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-3eaf5624-97eb-45e2-84d9-5291b28c95c7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:32.242128 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3eaf5624-97eb-45e2-84d9-5291b28c95c7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1362 microversion: 2.1 time: 0.231917 Nov 16 19:06:32.242686 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 282/584] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:32 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:32.779672 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e3c3b04e-0e71-4811-b361-7a33e4a1727b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:32.780667 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e3c3b04e-0e71-4811-b361-7a33e4a1727b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:32.787465 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e3c3b04e-0e71-4811-b361-7a33e4a1727b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:32.787905 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e3c3b04e-0e71-4811-b361-7a33e4a1727b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:32.788669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e3c3b04e-0e71-4811-b361-7a33e4a1727b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:32.789097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e3c3b04e-0e71-4811-b361-7a33e4a1727b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:32.848061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e3c3b04e-0e71-4811-b361-7a33e4a1727b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.072380 Nov 16 19:06:32.848659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 303/585] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:32 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:33.258854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f03c1bb7-cf1d-41fa-b37e-8734f3a322cb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:33.259457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f03c1bb7-cf1d-41fa-b37e-8734f3a322cb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:33.265671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f03c1bb7-cf1d-41fa-b37e-8734f3a322cb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:33.266114 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f03c1bb7-cf1d-41fa-b37e-8734f3a322cb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:33.266877 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f03c1bb7-cf1d-41fa-b37e-8734f3a322cb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:33.267306 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f03c1bb7-cf1d-41fa-b37e-8734f3a322cb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:33.395886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f03c1bb7-cf1d-41fa-b37e-8734f3a322cb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:33.403208 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f03c1bb7-cf1d-41fa-b37e-8734f3a322cb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1362 microversion: 2.1 time: 0.148199 Nov 16 19:06:33.403963 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 283/586] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:33 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:33.859190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-83628ad6-2fc9-41b9-bd6c-65634dc24dfd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:33.860138 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-83628ad6-2fc9-41b9-bd6c-65634dc24dfd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:33.866898 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83628ad6-2fc9-41b9-bd6c-65634dc24dfd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:33.867342 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83628ad6-2fc9-41b9-bd6c-65634dc24dfd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:33.868110 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83628ad6-2fc9-41b9-bd6c-65634dc24dfd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:33.868544 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83628ad6-2fc9-41b9-bd6c-65634dc24dfd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:33.937569 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-83628ad6-2fc9-41b9-bd6c-65634dc24dfd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14 microversion: 2.20 time: 0.082379 Nov 16 19:06:33.938181 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 304/587] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:33 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:34.420596 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-79cc0511-b7a8-4f48-af71-7bd8be6c8c93 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:34.421128 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-79cc0511-b7a8-4f48-af71-7bd8be6c8c93 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:34.427922 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-79cc0511-b7a8-4f48-af71-7bd8be6c8c93 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:34.428370 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-79cc0511-b7a8-4f48-af71-7bd8be6c8c93 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:34.429134 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-79cc0511-b7a8-4f48-af71-7bd8be6c8c93 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:34.429580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-79cc0511-b7a8-4f48-af71-7bd8be6c8c93 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:34.558353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-79cc0511-b7a8-4f48-af71-7bd8be6c8c93 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:34.565381 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-79cc0511-b7a8-4f48-af71-7bd8be6c8c93 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1362 microversion: 2.1 time: 0.148525 Nov 16 19:06:34.565966 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 284/588] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:34 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:34.948213 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-87e4bf9c-8b28-4c86-ac2e-7153180fe4d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:34.949197 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-87e4bf9c-8b28-4c86-ac2e-7153180fe4d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:34.956044 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87e4bf9c-8b28-4c86-ac2e-7153180fe4d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:34.956429 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87e4bf9c-8b28-4c86-ac2e-7153180fe4d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:34.957187 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87e4bf9c-8b28-4c86-ac2e-7153180fe4d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:34.957646 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87e4bf9c-8b28-4c86-ac2e-7153180fe4d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:35.031546 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-87e4bf9c-8b28-4c86-ac2e-7153180fe4d2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 3356 microversion: 2.20 time: 0.087266 Nov 16 19:06:35.032173 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 305/589] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:34 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 3356 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:06:35.452808 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-2794b46d-8b91-4e83-9373-d56579b51891 req-36541415-d7eb-4ac0-b542-6997f62b39f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa66316-7216-4224-92a2-7280db37d232", "name": "network-vif-plugged", "status": "completed", "tag": "2e45e72d-543c-4ccf-ae9c-db23235939c9"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:35.454393 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:06:35.454393 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:06:35.462422 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-2794b46d-8b91-4e83-9373-d56579b51891 req-36541415-d7eb-4ac0-b542-6997f62b39f8 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:35.462864 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-2794b46d-8b91-4e83-9373-d56579b51891 req-36541415-d7eb-4ac0-b542-6997f62b39f8 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:35.473897 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-2794b46d-8b91-4e83-9373-d56579b51891 req-36541415-d7eb-4ac0-b542-6997f62b39f8 service nova] Creating event network-vif-plugged:2e45e72d-543c-4ccf-ae9c-db23235939c9 for instance 9fa66316-7216-4224-92a2-7280db37d232 on hv-cinder-66710 Nov 16 19:06:35.478600 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-2794b46d-8b91-4e83-9373-d56579b51891 req-36541415-d7eb-4ac0-b542-6997f62b39f8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029394 Nov 16 19:06:35.479180 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 285/590] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:06:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:06:35.583184 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1557354c-991f-4cba-98e7-63aca16acd8e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:35.583922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1557354c-991f-4cba-98e7-63aca16acd8e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:35.591260 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1557354c-991f-4cba-98e7-63aca16acd8e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:35.591711 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1557354c-991f-4cba-98e7-63aca16acd8e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:35.592489 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1557354c-991f-4cba-98e7-63aca16acd8e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:35.592921 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1557354c-991f-4cba-98e7-63aca16acd8e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:35.727189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1557354c-991f-4cba-98e7-63aca16acd8e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:35.734505 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1557354c-991f-4cba-98e7-63aca16acd8e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1362 microversion: 2.1 time: 0.155364 Nov 16 19:06:35.735249 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 306/591] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:35 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:36.043556 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ad575bd4-f197-439e-a99d-24d75e50ba73 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:36.044582 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ad575bd4-f197-439e-a99d-24d75e50ba73 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:36.050600 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ad575bd4-f197-439e-a99d-24d75e50ba73 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:36.051050 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ad575bd4-f197-439e-a99d-24d75e50ba73 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:36.051822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ad575bd4-f197-439e-a99d-24d75e50ba73 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:36.052260 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ad575bd4-f197-439e-a99d-24d75e50ba73 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:36.133909 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ad575bd4-f197-439e-a99d-24d75e50ba73 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 14986 microversion: 2.20 time: 0.094239 Nov 16 19:06:36.134535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 286/592] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:36 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 14986 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:36.751861 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f9efb3e8-ed39-4e48-a666-eb63b2d9471f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:36.752451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f9efb3e8-ed39-4e48-a666-eb63b2d9471f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:36.759692 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9efb3e8-ed39-4e48-a666-eb63b2d9471f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:36.760365 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9efb3e8-ed39-4e48-a666-eb63b2d9471f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:36.761005 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9efb3e8-ed39-4e48-a666-eb63b2d9471f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:36.761794 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9efb3e8-ed39-4e48-a666-eb63b2d9471f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:36.896144 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f9efb3e8-ed39-4e48-a666-eb63b2d9471f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:36.903782 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f9efb3e8-ed39-4e48-a666-eb63b2d9471f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1362 microversion: 2.1 time: 0.155611 Nov 16 19:06:36.904344 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 307/593] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:36 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:37.145908 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-197fdb4f-3028-4b4d-8d08-9114958803db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:37.146964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-197fdb4f-3028-4b4d-8d08-9114958803db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:37.153715 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-197fdb4f-3028-4b4d-8d08-9114958803db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:37.154163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-197fdb4f-3028-4b4d-8d08-9114958803db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:37.154928 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-197fdb4f-3028-4b4d-8d08-9114958803db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:37.155354 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-197fdb4f-3028-4b4d-8d08-9114958803db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:37.227856 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-197fdb4f-3028-4b4d-8d08-9114958803db tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 18155 microversion: 2.20 time: 0.085887 Nov 16 19:06:37.231568 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 287/594] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:37 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 18155 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:37.919898 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-40787432-6bba-4043-bee4-c75622d9fe81 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:37.920493 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-40787432-6bba-4043-bee4-c75622d9fe81 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:37.926689 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40787432-6bba-4043-bee4-c75622d9fe81 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:37.927131 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40787432-6bba-4043-bee4-c75622d9fe81 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:37.927893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40787432-6bba-4043-bee4-c75622d9fe81 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:37.928318 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40787432-6bba-4043-bee4-c75622d9fe81 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:38.056470 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-40787432-6bba-4043-bee4-c75622d9fe81 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:06:38.063602 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-40787432-6bba-4043-bee4-c75622d9fe81 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1545 microversion: 2.1 time: 0.147361 Nov 16 19:06:38.064159 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 308/595] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:06:37 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1545 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:06:38.080539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b871b3cb-48dc-4f42-b789-d4cdfb95799a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:06:38.081102 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b871b3cb-48dc-4f42-b789-d4cdfb95799a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:38.087754 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b871b3cb-48dc-4f42-b789-d4cdfb95799a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:38.088196 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b871b3cb-48dc-4f42-b789-d4cdfb95799a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:38.088951 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b871b3cb-48dc-4f42-b789-d4cdfb95799a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:38.089376 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b871b3cb-48dc-4f42-b789-d4cdfb95799a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:38.167222 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b871b3cb-48dc-4f42-b789-d4cdfb95799a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090571 Nov 16 19:06:38.167806 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 288/596] 10.222.0.46 () {58 vars in 1274 bytes} [Tue Nov 16 19:06:38 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:06:38.239517 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b3cd029a-4fd2-41d1-bb10-693fe3362342 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:38.241013 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b3cd029a-4fd2-41d1-bb10-693fe3362342 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:38.246807 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b3cd029a-4fd2-41d1-bb10-693fe3362342 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:38.247255 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b3cd029a-4fd2-41d1-bb10-693fe3362342 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:38.248029 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b3cd029a-4fd2-41d1-bb10-693fe3362342 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:38.248464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b3cd029a-4fd2-41d1-bb10-693fe3362342 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:38.320942 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b3cd029a-4fd2-41d1-bb10-693fe3362342 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 19342 microversion: 2.20 time: 0.084968 Nov 16 19:06:38.322476 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 309/597] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:38 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 19342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:39.060817 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a940f810-f68b-4f6c-9de7-f47a74fd744e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:39.061789 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a940f810-f68b-4f6c-9de7-f47a74fd744e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:39.063747 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-c2967215-dc88-4336-99f3-5e5667c001f0 req-42656aca-b0ae-4d73-970f-c27740f6832e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa66316-7216-4224-92a2-7280db37d232", "tag": "2e45e72d-543c-4ccf-ae9c-db23235939c9"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:39.065347 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:06:39.065347 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:06:39.068869 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a940f810-f68b-4f6c-9de7-f47a74fd744e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:39.069318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a940f810-f68b-4f6c-9de7-f47a74fd744e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:39.070116 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a940f810-f68b-4f6c-9de7-f47a74fd744e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:39.070541 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a940f810-f68b-4f6c-9de7-f47a74fd744e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:39.074108 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-c2967215-dc88-4336-99f3-5e5667c001f0 req-42656aca-b0ae-4d73-970f-c27740f6832e service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:39.074630 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-c2967215-dc88-4336-99f3-5e5667c001f0 req-42656aca-b0ae-4d73-970f-c27740f6832e service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:39.086458 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-c2967215-dc88-4336-99f3-5e5667c001f0 req-42656aca-b0ae-4d73-970f-c27740f6832e service nova] Creating event network-changed:2e45e72d-543c-4ccf-ae9c-db23235939c9 for instance 9fa66316-7216-4224-92a2-7280db37d232 on hv-cinder-66710 Nov 16 19:06:39.091375 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-c2967215-dc88-4336-99f3-5e5667c001f0 req-42656aca-b0ae-4d73-970f-c27740f6832e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031608 Nov 16 19:06:39.092400 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 310/598] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:06:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:06:39.140040 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a940f810-f68b-4f6c-9de7-f47a74fd744e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.082423 Nov 16 19:06:39.140682 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 289/599] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:39 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:39.332897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-82c397f7-dd6f-4ce6-94d9-b578b26d9651 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:39.334039 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-82c397f7-dd6f-4ce6-94d9-b578b26d9651 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:39.340570 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82c397f7-dd6f-4ce6-94d9-b578b26d9651 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:39.341028 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82c397f7-dd6f-4ce6-94d9-b578b26d9651 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:39.345442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82c397f7-dd6f-4ce6-94d9-b578b26d9651 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:39.345442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82c397f7-dd6f-4ce6-94d9-b578b26d9651 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:39.421975 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-82c397f7-dd6f-4ce6-94d9-b578b26d9651 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 21972 microversion: 2.20 time: 0.092864 Nov 16 19:06:39.425736 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 311/600] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:39 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 21972 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:40.152027 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c28e7996-86e7-40fb-99b5-869246a91c48 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:40.153032 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c28e7996-86e7-40fb-99b5-869246a91c48 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:40.160043 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c28e7996-86e7-40fb-99b5-869246a91c48 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:40.160420 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c28e7996-86e7-40fb-99b5-869246a91c48 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:40.161205 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c28e7996-86e7-40fb-99b5-869246a91c48 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:40.161663 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c28e7996-86e7-40fb-99b5-869246a91c48 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:40.218976 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c28e7996-86e7-40fb-99b5-869246a91c48 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.070801 Nov 16 19:06:40.222168 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 290/601] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:40 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 19:06:40.434319 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-14a5052f-0f9c-428d-aa35-49e7cccb9886 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:40.435258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-14a5052f-0f9c-428d-aa35-49e7cccb9886 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:40.442073 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14a5052f-0f9c-428d-aa35-49e7cccb9886 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:40.442527 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14a5052f-0f9c-428d-aa35-49e7cccb9886 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:40.443902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14a5052f-0f9c-428d-aa35-49e7cccb9886 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:40.444345 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14a5052f-0f9c-428d-aa35-49e7cccb9886 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:40.514953 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-14a5052f-0f9c-428d-aa35-49e7cccb9886 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 23235 microversion: 2.20 time: 0.084581 Nov 16 19:06:40.515555 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 312/602] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:40 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 23235 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:41.230972 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b66108b7-1859-44ad-9e80-2694445cb0fe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:41.231977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b66108b7-1859-44ad-9e80-2694445cb0fe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:41.238929 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b66108b7-1859-44ad-9e80-2694445cb0fe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:41.239371 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b66108b7-1859-44ad-9e80-2694445cb0fe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:41.240169 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b66108b7-1859-44ad-9e80-2694445cb0fe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:41.240599 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b66108b7-1859-44ad-9e80-2694445cb0fe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:41.299329 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b66108b7-1859-44ad-9e80-2694445cb0fe tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.072246 Nov 16 19:06:41.299950 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 291/603] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:41 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:41.527502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dd1e7c69-9bd9-4362-94f1-90d0a7b436b4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:41.528501 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dd1e7c69-9bd9-4362-94f1-90d0a7b436b4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:41.535348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd1e7c69-9bd9-4362-94f1-90d0a7b436b4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:41.535795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd1e7c69-9bd9-4362-94f1-90d0a7b436b4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:41.536568 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd1e7c69-9bd9-4362-94f1-90d0a7b436b4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:41.537003 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd1e7c69-9bd9-4362-94f1-90d0a7b436b4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:41.611847 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dd1e7c69-9bd9-4362-94f1-90d0a7b436b4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 24975 microversion: 2.20 time: 0.088279 Nov 16 19:06:41.612502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 313/604] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:41 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 24975 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:42.310566 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a21abd8a-b827-46eb-94bf-bb28fcfa2e59 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:42.311593 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a21abd8a-b827-46eb-94bf-bb28fcfa2e59 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:42.318885 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a21abd8a-b827-46eb-94bf-bb28fcfa2e59 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:42.319331 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a21abd8a-b827-46eb-94bf-bb28fcfa2e59 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:42.320098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a21abd8a-b827-46eb-94bf-bb28fcfa2e59 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:42.320532 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a21abd8a-b827-46eb-94bf-bb28fcfa2e59 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:42.383750 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a21abd8a-b827-46eb-94bf-bb28fcfa2e59 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.077082 Nov 16 19:06:42.384358 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 292/605] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:42 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:42.623826 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-097b0ef0-cd92-4ed7-abd4-36f97c9be635 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:42.624805 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-097b0ef0-cd92-4ed7-abd4-36f97c9be635 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:42.631942 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-097b0ef0-cd92-4ed7-abd4-36f97c9be635 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:42.632393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-097b0ef0-cd92-4ed7-abd4-36f97c9be635 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:42.633254 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-097b0ef0-cd92-4ed7-abd4-36f97c9be635 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:42.634073 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-097b0ef0-cd92-4ed7-abd4-36f97c9be635 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:42.705157 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-097b0ef0-cd92-4ed7-abd4-36f97c9be635 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 26394 microversion: 2.20 time: 0.085286 Nov 16 19:06:42.705795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 314/606] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:42 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 26394 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:43.394654 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-181f57cc-7104-40f4-b6a3-c5a356d55017 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:43.395654 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-181f57cc-7104-40f4-b6a3-c5a356d55017 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:43.402515 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-181f57cc-7104-40f4-b6a3-c5a356d55017 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:43.402965 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-181f57cc-7104-40f4-b6a3-c5a356d55017 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:43.403742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-181f57cc-7104-40f4-b6a3-c5a356d55017 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:43.404179 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-181f57cc-7104-40f4-b6a3-c5a356d55017 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:43.469321 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-181f57cc-7104-40f4-b6a3-c5a356d55017 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.078516 Nov 16 19:06:43.469876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 293/607] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:43 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:43.717747 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4f2be33b-12d7-4a8e-858a-864cea162dc5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:43.718746 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4f2be33b-12d7-4a8e-858a-864cea162dc5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:43.726200 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4f2be33b-12d7-4a8e-858a-864cea162dc5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:43.726587 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4f2be33b-12d7-4a8e-858a-864cea162dc5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:43.727355 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4f2be33b-12d7-4a8e-858a-864cea162dc5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:43.727790 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4f2be33b-12d7-4a8e-858a-864cea162dc5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:43.800598 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4f2be33b-12d7-4a8e-858a-864cea162dc5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 27440 microversion: 2.20 time: 0.086734 Nov 16 19:06:43.801927 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 315/608] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:43 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 27440 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:06:44.480680 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c958c551-d84a-4e5d-9bcd-5424eed028e7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:44.481618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c958c551-d84a-4e5d-9bcd-5424eed028e7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:44.488392 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c958c551-d84a-4e5d-9bcd-5424eed028e7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:44.488840 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c958c551-d84a-4e5d-9bcd-5424eed028e7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:44.489647 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c958c551-d84a-4e5d-9bcd-5424eed028e7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:44.490082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c958c551-d84a-4e5d-9bcd-5424eed028e7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:44.549184 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c958c551-d84a-4e5d-9bcd-5424eed028e7 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.072540 Nov 16 19:06:44.549820 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 294/609] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:44 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:44.812836 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9db2cc27-447c-4b3b-86aa-e6c349242c4d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:44.813780 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9db2cc27-447c-4b3b-86aa-e6c349242c4d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:44.820673 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9db2cc27-447c-4b3b-86aa-e6c349242c4d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:44.821123 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9db2cc27-447c-4b3b-86aa-e6c349242c4d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:44.821913 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9db2cc27-447c-4b3b-86aa-e6c349242c4d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:44.822342 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9db2cc27-447c-4b3b-86aa-e6c349242c4d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:44.894470 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9db2cc27-447c-4b3b-86aa-e6c349242c4d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 27924 microversion: 2.20 time: 0.085664 Nov 16 19:06:44.895073 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 316/610] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:44 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 27924 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:45.560465 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-962dd4d6-1058-4b32-9bac-b808c2794a5f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:45.561423 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-962dd4d6-1058-4b32-9bac-b808c2794a5f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:45.568139 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-962dd4d6-1058-4b32-9bac-b808c2794a5f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:45.568580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-962dd4d6-1058-4b32-9bac-b808c2794a5f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:45.569344 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-962dd4d6-1058-4b32-9bac-b808c2794a5f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:45.569797 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-962dd4d6-1058-4b32-9bac-b808c2794a5f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:45.627311 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-962dd4d6-1058-4b32-9bac-b808c2794a5f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.070821 Nov 16 19:06:45.627884 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 295/611] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:45 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:45.906782 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-089fdbf0-be26-417a-9495-3756b1edbde0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:45.908005 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-089fdbf0-be26-417a-9495-3756b1edbde0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:45.914855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-089fdbf0-be26-417a-9495-3756b1edbde0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:45.915300 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-089fdbf0-be26-417a-9495-3756b1edbde0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:45.916056 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-089fdbf0-be26-417a-9495-3756b1edbde0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:45.916489 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-089fdbf0-be26-417a-9495-3756b1edbde0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:45.996145 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-089fdbf0-be26-417a-9495-3756b1edbde0 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 28178 microversion: 2.20 time: 0.093264 Nov 16 19:06:45.996777 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 317/612] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:45 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 28178 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:46.638853 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-51b6f2f6-fb6a-4aa1-a609-0834481d0220 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:46.639875 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-51b6f2f6-fb6a-4aa1-a609-0834481d0220 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:46.646885 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-51b6f2f6-fb6a-4aa1-a609-0834481d0220 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:46.647337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-51b6f2f6-fb6a-4aa1-a609-0834481d0220 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:46.648115 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-51b6f2f6-fb6a-4aa1-a609-0834481d0220 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:46.648549 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-51b6f2f6-fb6a-4aa1-a609-0834481d0220 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:46.707163 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-51b6f2f6-fb6a-4aa1-a609-0834481d0220 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.072239 Nov 16 19:06:46.707780 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 296/613] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:46 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:47.008395 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f3cc1c1e-2946-4ebb-8173-5e2a94586546 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:47.009311 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f3cc1c1e-2946-4ebb-8173-5e2a94586546 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:47.016051 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3cc1c1e-2946-4ebb-8173-5e2a94586546 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:47.016494 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3cc1c1e-2946-4ebb-8173-5e2a94586546 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:47.017253 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3cc1c1e-2946-4ebb-8173-5e2a94586546 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:47.017713 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3cc1c1e-2946-4ebb-8173-5e2a94586546 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:47.094042 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f3cc1c1e-2946-4ebb-8173-5e2a94586546 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 28193 microversion: 2.20 time: 0.089815 Nov 16 19:06:47.094652 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 318/614] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:47 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 28193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:47.718728 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d6d7f06e-d68f-4ab2-b398-098242534f90 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:47.720069 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d6d7f06e-d68f-4ab2-b398-098242534f90 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:47.727690 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d6d7f06e-d68f-4ab2-b398-098242534f90 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:47.728114 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d6d7f06e-d68f-4ab2-b398-098242534f90 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:47.728895 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d6d7f06e-d68f-4ab2-b398-098242534f90 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:47.729325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d6d7f06e-d68f-4ab2-b398-098242534f90 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:47.789005 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d6d7f06e-d68f-4ab2-b398-098242534f90 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.074040 Nov 16 19:06:47.789913 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 297/615] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:47 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:48.106180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fc1376bb-2694-4bfb-9c64-d3e90620bbde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:48.107096 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fc1376bb-2694-4bfb-9c64-d3e90620bbde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:48.114133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc1376bb-2694-4bfb-9c64-d3e90620bbde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:48.114572 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc1376bb-2694-4bfb-9c64-d3e90620bbde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:48.115340 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc1376bb-2694-4bfb-9c64-d3e90620bbde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:48.115769 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc1376bb-2694-4bfb-9c64-d3e90620bbde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:48.191832 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fc1376bb-2694-4bfb-9c64-d3e90620bbde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 28469 microversion: 2.20 time: 0.089684 Nov 16 19:06:48.192462 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 319/616] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:48 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 28469 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:48.800162 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0497f0e8-f7be-43f3-90ec-26720fc6a152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:48.801164 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0497f0e8-f7be-43f3-90ec-26720fc6a152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:48.809518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0497f0e8-f7be-43f3-90ec-26720fc6a152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:48.809997 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0497f0e8-f7be-43f3-90ec-26720fc6a152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:48.810775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0497f0e8-f7be-43f3-90ec-26720fc6a152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:48.811204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0497f0e8-f7be-43f3-90ec-26720fc6a152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:48.871783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0497f0e8-f7be-43f3-90ec-26720fc6a152 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 14 microversion: 2.1 time: 0.075560 Nov 16 19:06:48.872387 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 298/617] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:48 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:06:49.204723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a940209a-bb05-4277-b6b8-a9450e03e1f6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:49.205743 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a940209a-bb05-4277-b6b8-a9450e03e1f6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:49.212410 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a940209a-bb05-4277-b6b8-a9450e03e1f6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:49.212856 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a940209a-bb05-4277-b6b8-a9450e03e1f6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:49.213632 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a940209a-bb05-4277-b6b8-a9450e03e1f6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:49.214061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a940209a-bb05-4277-b6b8-a9450e03e1f6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:49.294708 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a940209a-bb05-4277-b6b8-a9450e03e1f6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 28637 microversion: 2.20 time: 0.094134 Nov 16 19:06:49.295337 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 320/618] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:49 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 28637 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:06:49.883199 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-442a027b-d528-44f4-9f12-8dfbd7142e6e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:49.884195 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-442a027b-d528-44f4-9f12-8dfbd7142e6e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:49.890939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-442a027b-d528-44f4-9f12-8dfbd7142e6e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:49.891387 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-442a027b-d528-44f4-9f12-8dfbd7142e6e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:49.892158 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-442a027b-d528-44f4-9f12-8dfbd7142e6e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:49.892587 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-442a027b-d528-44f4-9f12-8dfbd7142e6e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:49.967263 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-442a027b-d528-44f4-9f12-8dfbd7142e6e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 10872 microversion: 2.1 time: 0.088222 Nov 16 19:06:49.967861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 299/619] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:49 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 10872 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:50.306703 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b9fa2f96-75c4-4962-8b9d-de287e201594 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:50.307715 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b9fa2f96-75c4-4962-8b9d-de287e201594 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:50.314583 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b9fa2f96-75c4-4962-8b9d-de287e201594 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:50.315029 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b9fa2f96-75c4-4962-8b9d-de287e201594 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:50.315807 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b9fa2f96-75c4-4962-8b9d-de287e201594 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:50.316251 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b9fa2f96-75c4-4962-8b9d-de287e201594 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:50.382180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b9fa2f96-75c4-4962-8b9d-de287e201594 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 28637 microversion: 2.20 time: 0.078876 Nov 16 19:06:50.382802 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 321/620] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:50 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 28637 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:50.979304 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9bfa9132-5641-467b-b962-00118c95fc9d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:50.980315 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9bfa9132-5641-467b-b962-00118c95fc9d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:50.987452 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9bfa9132-5641-467b-b962-00118c95fc9d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:50.987584 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9bfa9132-5641-467b-b962-00118c95fc9d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:50.988293 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9bfa9132-5641-467b-b962-00118c95fc9d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:50.988719 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9bfa9132-5641-467b-b962-00118c95fc9d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:51.060544 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9bfa9132-5641-467b-b962-00118c95fc9d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 17155 microversion: 2.1 time: 0.085751 Nov 16 19:06:51.061132 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 300/621] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:50 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 17155 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:51.394161 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a18158e7-45ab-4bb4-85d3-26cc5e29d6b7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:51.395157 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a18158e7-45ab-4bb4-85d3-26cc5e29d6b7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:51.402712 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a18158e7-45ab-4bb4-85d3-26cc5e29d6b7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:51.403155 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a18158e7-45ab-4bb4-85d3-26cc5e29d6b7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:51.403921 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a18158e7-45ab-4bb4-85d3-26cc5e29d6b7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:51.404377 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a18158e7-45ab-4bb4-85d3-26cc5e29d6b7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:51.464352 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a18158e7-45ab-4bb4-85d3-26cc5e29d6b7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 28637 microversion: 2.20 time: 0.074097 Nov 16 19:06:51.465213 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 322/622] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:51 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 28637 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:52.072803 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8ad6ad00-c6e3-4b66-9706-5c9f211b5e97 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:52.073839 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8ad6ad00-c6e3-4b66-9706-5c9f211b5e97 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:52.080671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ad6ad00-c6e3-4b66-9706-5c9f211b5e97 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:52.081116 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ad6ad00-c6e3-4b66-9706-5c9f211b5e97 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:52.081909 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ad6ad00-c6e3-4b66-9706-5c9f211b5e97 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:52.082338 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ad6ad00-c6e3-4b66-9706-5c9f211b5e97 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:52.162139 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8ad6ad00-c6e3-4b66-9706-5c9f211b5e97 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 18449 microversion: 2.1 time: 0.093137 Nov 16 19:06:52.162139 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 301/623] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:52 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 18449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:52.476354 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4b7d8c6d-6204-42ec-aafc-2ec1dbafc397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:52.477341 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4b7d8c6d-6204-42ec-aafc-2ec1dbafc397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:52.484119 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c6d-6204-42ec-aafc-2ec1dbafc397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:52.484560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c6d-6204-42ec-aafc-2ec1dbafc397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:52.485317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c6d-6204-42ec-aafc-2ec1dbafc397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:52.485775 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b7d8c6d-6204-42ec-aafc-2ec1dbafc397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:52.563153 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4b7d8c6d-6204-42ec-aafc-2ec1dbafc397 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 29125 microversion: 2.20 time: 0.090731 Nov 16 19:06:52.563772 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 323/624] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:52 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 29125 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:53.172743 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6b079730-c0d7-4a5e-8df7-7fbdca40e860 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:53.173769 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6b079730-c0d7-4a5e-8df7-7fbdca40e860 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:53.180534 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b079730-c0d7-4a5e-8df7-7fbdca40e860 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:53.180979 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b079730-c0d7-4a5e-8df7-7fbdca40e860 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:53.181786 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b079730-c0d7-4a5e-8df7-7fbdca40e860 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:53.182220 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b079730-c0d7-4a5e-8df7-7fbdca40e860 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:53.256113 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6b079730-c0d7-4a5e-8df7-7fbdca40e860 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 20839 microversion: 2.1 time: 0.087281 Nov 16 19:06:53.256752 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 302/625] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:53 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 20839 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:53.575831 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-804c0045-7e11-43af-939c-d4aa08e0675a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:53.576750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-804c0045-7e11-43af-939c-d4aa08e0675a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:53.583522 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-804c0045-7e11-43af-939c-d4aa08e0675a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:53.583965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-804c0045-7e11-43af-939c-d4aa08e0675a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:53.585351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-804c0045-7e11-43af-939c-d4aa08e0675a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:53.585811 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-804c0045-7e11-43af-939c-d4aa08e0675a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:53.666944 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-804c0045-7e11-43af-939c-d4aa08e0675a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 31034 microversion: 2.20 time: 0.095098 Nov 16 19:06:53.667542 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 324/626] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:53 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 31034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:54.267954 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-eb53b344-62ab-4992-b0eb-82bb5bd650c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:54.268947 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-eb53b344-62ab-4992-b0eb-82bb5bd650c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:54.275729 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-eb53b344-62ab-4992-b0eb-82bb5bd650c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:54.276171 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-eb53b344-62ab-4992-b0eb-82bb5bd650c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:54.276935 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-eb53b344-62ab-4992-b0eb-82bb5bd650c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:54.277367 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-eb53b344-62ab-4992-b0eb-82bb5bd650c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:54.351283 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-eb53b344-62ab-4992-b0eb-82bb5bd650c3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 22808 microversion: 2.1 time: 0.087174 Nov 16 19:06:54.352178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 303/627] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:54 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 22808 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:54.679571 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0ca685c4-39f9-457e-8f3d-ab67ba742107 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:54.680571 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0ca685c4-39f9-457e-8f3d-ab67ba742107 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:54.687280 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0ca685c4-39f9-457e-8f3d-ab67ba742107 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:54.687722 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0ca685c4-39f9-457e-8f3d-ab67ba742107 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:54.688482 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0ca685c4-39f9-457e-8f3d-ab67ba742107 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:54.688911 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0ca685c4-39f9-457e-8f3d-ab67ba742107 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:54.783041 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0ca685c4-39f9-457e-8f3d-ab67ba742107 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 32912 microversion: 2.20 time: 0.108007 Nov 16 19:06:54.783642 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 325/628] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:54 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 32912 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:55.363407 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9ae2c80c-377d-4e5f-b50c-4cfd870d691e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:55.364415 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9ae2c80c-377d-4e5f-b50c-4cfd870d691e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:55.371562 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ae2c80c-377d-4e5f-b50c-4cfd870d691e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:55.371946 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ae2c80c-377d-4e5f-b50c-4cfd870d691e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:55.372707 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ae2c80c-377d-4e5f-b50c-4cfd870d691e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:55.373139 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ae2c80c-377d-4e5f-b50c-4cfd870d691e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:55.446031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9ae2c80c-377d-4e5f-b50c-4cfd870d691e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 23803 microversion: 2.1 time: 0.086666 Nov 16 19:06:55.446642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 304/629] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:55 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 23803 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:55.795131 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3009796c-2a46-4bd3-be16-f79e6b615662 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:55.796178 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3009796c-2a46-4bd3-be16-f79e6b615662 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:55.803003 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3009796c-2a46-4bd3-be16-f79e6b615662 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:55.803454 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3009796c-2a46-4bd3-be16-f79e6b615662 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:55.804227 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3009796c-2a46-4bd3-be16-f79e6b615662 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:55.804664 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3009796c-2a46-4bd3-be16-f79e6b615662 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:55.878861 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3009796c-2a46-4bd3-be16-f79e6b615662 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 33861 microversion: 2.20 time: 0.087684 Nov 16 19:06:55.879984 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 326/630] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:55 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 33861 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:56.458219 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0f4fefcb-bd9a-4e49-bc7b-541b1809eecb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:56.459143 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0f4fefcb-bd9a-4e49-bc7b-541b1809eecb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:56.465909 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f4fefcb-bd9a-4e49-bc7b-541b1809eecb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:56.466356 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f4fefcb-bd9a-4e49-bc7b-541b1809eecb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:56.467122 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f4fefcb-bd9a-4e49-bc7b-541b1809eecb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:56.467553 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0f4fefcb-bd9a-4e49-bc7b-541b1809eecb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:56.542197 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0f4fefcb-bd9a-4e49-bc7b-541b1809eecb tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 25541 microversion: 2.1 time: 0.087980 Nov 16 19:06:56.542799 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 305/631] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:56 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 25541 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:56.891654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cdae67e2-7c7c-42ad-9d80-5b5d15e1a4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:56.892645 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cdae67e2-7c7c-42ad-9d80-5b5d15e1a4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:56.900171 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cdae67e2-7c7c-42ad-9d80-5b5d15e1a4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:56.900620 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cdae67e2-7c7c-42ad-9d80-5b5d15e1a4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:56.901393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cdae67e2-7c7c-42ad-9d80-5b5d15e1a4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:56.901883 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cdae67e2-7c7c-42ad-9d80-5b5d15e1a4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:56.974677 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cdae67e2-7c7c-42ad-9d80-5b5d15e1a4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 34954 microversion: 2.20 time: 0.086902 Nov 16 19:06:56.975285 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 327/632] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:56 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 34954 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:57.554456 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9c140a21-ec10-472c-b7a9-9c2460a7ff03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:57.555453 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9c140a21-ec10-472c-b7a9-9c2460a7ff03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:57.562323 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9c140a21-ec10-472c-b7a9-9c2460a7ff03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:57.562769 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9c140a21-ec10-472c-b7a9-9c2460a7ff03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:57.563533 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9c140a21-ec10-472c-b7a9-9c2460a7ff03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:57.563963 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9c140a21-ec10-472c-b7a9-9c2460a7ff03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:57.641871 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9c140a21-ec10-472c-b7a9-9c2460a7ff03 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 26756 microversion: 2.1 time: 0.091937 Nov 16 19:06:57.642735 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 306/633] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:57 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 26756 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:57.987715 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b1ae810b-bb11-475a-b6e1-eb1447d2d39b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:57.988660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b1ae810b-bb11-475a-b6e1-eb1447d2d39b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:57.996029 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1ae810b-bb11-475a-b6e1-eb1447d2d39b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:57.996468 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1ae810b-bb11-475a-b6e1-eb1447d2d39b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:57.997221 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1ae810b-bb11-475a-b6e1-eb1447d2d39b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:57.997675 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1ae810b-bb11-475a-b6e1-eb1447d2d39b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:58.070690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b1ae810b-bb11-475a-b6e1-eb1447d2d39b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 36054 microversion: 2.20 time: 0.086930 Nov 16 19:06:58.071287 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 328/634] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:57 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 36054 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:58.653827 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a2839e35-8f48-448b-a943-8caafdbc27a4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:58.654829 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a2839e35-8f48-448b-a943-8caafdbc27a4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:58.661598 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a2839e35-8f48-448b-a943-8caafdbc27a4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:58.662047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a2839e35-8f48-448b-a943-8caafdbc27a4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:58.662815 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a2839e35-8f48-448b-a943-8caafdbc27a4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:58.663742 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a2839e35-8f48-448b-a943-8caafdbc27a4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:58.740805 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a2839e35-8f48-448b-a943-8caafdbc27a4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 27608 microversion: 2.1 time: 0.091539 Nov 16 19:06:58.742101 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 307/635] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:58 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 27608 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:06:59.082860 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-52b198b3-a8d2-4743-a6d6-aa3daf2ddbe7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:59.083771 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-52b198b3-a8d2-4743-a6d6-aa3daf2ddbe7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:59.091018 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52b198b3-a8d2-4743-a6d6-aa3daf2ddbe7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:59.091463 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52b198b3-a8d2-4743-a6d6-aa3daf2ddbe7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:59.092218 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52b198b3-a8d2-4743-a6d6-aa3daf2ddbe7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:59.092643 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52b198b3-a8d2-4743-a6d6-aa3daf2ddbe7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:59.165560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-52b198b3-a8d2-4743-a6d6-aa3daf2ddbe7 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 37689 microversion: 2.20 time: 0.086663 Nov 16 19:06:59.166194 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 329/636] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:06:59 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 37689 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:06:59.752602 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-af574e79-d7bd-480b-84a3-ff35c2c85e4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:06:59.753619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-af574e79-d7bd-480b-84a3-ff35c2c85e4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:06:59.761220 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-af574e79-d7bd-480b-84a3-ff35c2c85e4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:59.761702 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-af574e79-d7bd-480b-84a3-ff35c2c85e4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:59.762475 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-af574e79-d7bd-480b-84a3-ff35c2c85e4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:06:59.762902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-af574e79-d7bd-480b-84a3-ff35c2c85e4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:06:59.836478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-af574e79-d7bd-480b-84a3-ff35c2c85e4f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 28059 microversion: 2.1 time: 0.087765 Nov 16 19:06:59.837272 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 308/637] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:06:59 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 28059 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:00.177676 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-046b8135-9832-4212-9964-bb33fb2e38ca tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:00.179299 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-046b8135-9832-4212-9964-bb33fb2e38ca tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:00.186060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-046b8135-9832-4212-9964-bb33fb2e38ca tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:00.186504 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-046b8135-9832-4212-9964-bb33fb2e38ca tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:00.187265 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-046b8135-9832-4212-9964-bb33fb2e38ca tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:00.187694 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-046b8135-9832-4212-9964-bb33fb2e38ca tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:00.262858 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-046b8135-9832-4212-9964-bb33fb2e38ca tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 38194 microversion: 2.20 time: 0.089090 Nov 16 19:07:00.263464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 330/638] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:07:00 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 38194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:07:00.847902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-403f4bd0-211a-4f08-ae15-8c35f31a4db1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:00.848822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-403f4bd0-211a-4f08-ae15-8c35f31a4db1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:00.856210 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-403f4bd0-211a-4f08-ae15-8c35f31a4db1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:00.856650 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-403f4bd0-211a-4f08-ae15-8c35f31a4db1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:00.857662 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-403f4bd0-211a-4f08-ae15-8c35f31a4db1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:00.857871 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-403f4bd0-211a-4f08-ae15-8c35f31a4db1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:00.937464 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-403f4bd0-211a-4f08-ae15-8c35f31a4db1 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 28186 microversion: 2.1 time: 0.093550 Nov 16 19:07:00.938366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 309/639] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:00 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 28186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:01.274992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ca5856e6-d964-4bcd-a2f7-4d8681c0841e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:01.275999 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ca5856e6-d964-4bcd-a2f7-4d8681c0841e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:01.282778 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ca5856e6-d964-4bcd-a2f7-4d8681c0841e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:01.283228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ca5856e6-d964-4bcd-a2f7-4d8681c0841e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:01.283998 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ca5856e6-d964-4bcd-a2f7-4d8681c0841e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:01.284432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ca5856e6-d964-4bcd-a2f7-4d8681c0841e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:01.352980 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ca5856e6-d964-4bcd-a2f7-4d8681c0841e tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 38194 microversion: 2.20 time: 0.082354 Nov 16 19:07:01.353874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 331/640] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:07:01 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 38194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:07:01.949984 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-be8743c9-8c07-4788-8bf3-e8eb255d63f9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:01.951011 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-be8743c9-8c07-4788-8bf3-e8eb255d63f9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:01.957790 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-be8743c9-8c07-4788-8bf3-e8eb255d63f9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:01.958233 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-be8743c9-8c07-4788-8bf3-e8eb255d63f9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:01.958997 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-be8743c9-8c07-4788-8bf3-e8eb255d63f9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:01.959427 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-be8743c9-8c07-4788-8bf3-e8eb255d63f9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:02.035792 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-be8743c9-8c07-4788-8bf3-e8eb255d63f9 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 28201 microversion: 2.1 time: 0.089739 Nov 16 19:07:02.036619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 310/641] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:01 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 28201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:02.365077 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cba2dee3-8c57-4d0a-a83d-4267a1e4d790 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:02.366786 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cba2dee3-8c57-4d0a-a83d-4267a1e4d790 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:02.373632 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cba2dee3-8c57-4d0a-a83d-4267a1e4d790 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:02.374085 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cba2dee3-8c57-4d0a-a83d-4267a1e4d790 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:02.374853 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cba2dee3-8c57-4d0a-a83d-4267a1e4d790 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:02.375284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cba2dee3-8c57-4d0a-a83d-4267a1e4d790 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:02.436663 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cba2dee3-8c57-4d0a-a83d-4267a1e4d790 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 38194 microversion: 2.20 time: 0.075737 Nov 16 19:07:02.437277 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 332/642] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:07:02 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 38194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:07:03.049325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f764e567-b1c3-421e-af2a-5f081be1e5cc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:03.050492 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f764e567-b1c3-421e-af2a-5f081be1e5cc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:03.057248 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f764e567-b1c3-421e-af2a-5f081be1e5cc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:03.057732 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f764e567-b1c3-421e-af2a-5f081be1e5cc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:03.058498 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f764e567-b1c3-421e-af2a-5f081be1e5cc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:03.058927 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f764e567-b1c3-421e-af2a-5f081be1e5cc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:03.136388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f764e567-b1c3-421e-af2a-5f081be1e5cc tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 28477 microversion: 2.1 time: 0.092120 Nov 16 19:07:03.137002 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 311/643] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:03 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 28477 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:03.449635 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-544bb98b-f764-48b5-8408-323775b847ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:03.450640 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-544bb98b-f764-48b5-8408-323775b847ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:03.457428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-544bb98b-f764-48b5-8408-323775b847ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:03.457901 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-544bb98b-f764-48b5-8408-323775b847ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:03.458678 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-544bb98b-f764-48b5-8408-323775b847ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:03.459116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-544bb98b-f764-48b5-8408-323775b847ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:03.531438 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-544bb98b-f764-48b5-8408-323775b847ce tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 38199 microversion: 2.20 time: 0.085759 Nov 16 19:07:03.532317 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 333/644] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:07:03 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 38199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:07:04.148816 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4b5c3bcd-5533-4852-9f25-96aad68814aa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:04.149860 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4b5c3bcd-5533-4852-9f25-96aad68814aa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:04.156583 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b5c3bcd-5533-4852-9f25-96aad68814aa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:04.157034 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b5c3bcd-5533-4852-9f25-96aad68814aa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:04.157839 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b5c3bcd-5533-4852-9f25-96aad68814aa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:04.158270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b5c3bcd-5533-4852-9f25-96aad68814aa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:04.234856 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4b5c3bcd-5533-4852-9f25-96aad68814aa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 28645 microversion: 2.1 time: 0.090355 Nov 16 19:07:04.235599 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 312/645] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:04 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 28645 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:04.544337 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-274ea61a-fe1c-451c-be91-b8e92b1402c1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:04.545267 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-274ea61a-fe1c-451c-be91-b8e92b1402c1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:04.552138 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-274ea61a-fe1c-451c-be91-b8e92b1402c1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:04.552589 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-274ea61a-fe1c-451c-be91-b8e92b1402c1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:04.554012 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-274ea61a-fe1c-451c-be91-b8e92b1402c1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:04.554462 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-274ea61a-fe1c-451c-be91-b8e92b1402c1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:04.635848 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-274ea61a-fe1c-451c-be91-b8e92b1402c1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 200 len: 38337 microversion: 2.20 time: 0.095543 Nov 16 19:07:04.636479 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 334/646] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:07:04 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 38337 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:07:04.646642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-56b235c2-86d1-4bac-a213-3c4e1deb1028 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:04.647270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-56b235c2-86d1-4bac-a213-3c4e1deb1028 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:04.654044 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-56b235c2-86d1-4bac-a213-3c4e1deb1028 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:04.654485 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-56b235c2-86d1-4bac-a213-3c4e1deb1028 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:04.655243 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-56b235c2-86d1-4bac-a213-3c4e1deb1028 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:04.655665 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-56b235c2-86d1-4bac-a213-3c4e1deb1028 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:04.680227 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-56b235c2-86d1-4bac-a213-3c4e1deb1028 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/ips" status: 200 len: 149 microversion: 2.20 time: 0.037516 Nov 16 19:07:04.680794 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 313/647] 10.222.0.46 () {60 vars in 1288 bytes} [Tue Nov 16 19:07:04 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:05.247178 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-93d8d9b5-bb27-473c-86a6-923e044f7828 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:05.248227 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-93d8d9b5-bb27-473c-86a6-923e044f7828 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:05.255246 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93d8d9b5-bb27-473c-86a6-923e044f7828 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:05.255693 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93d8d9b5-bb27-473c-86a6-923e044f7828 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:05.256460 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93d8d9b5-bb27-473c-86a6-923e044f7828 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:05.256891 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93d8d9b5-bb27-473c-86a6-923e044f7828 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:05.321988 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-93d8d9b5-bb27-473c-86a6-923e044f7828 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 28645 microversion: 2.1 time: 0.078777 Nov 16 19:07:05.322608 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 335/648] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:05 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 28645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:06.333565 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fe36fa0f-5638-463f-babd-c56902460382 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:06.334481 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fe36fa0f-5638-463f-babd-c56902460382 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:06.341404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fe36fa0f-5638-463f-babd-c56902460382 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:06.341892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fe36fa0f-5638-463f-babd-c56902460382 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:06.342662 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fe36fa0f-5638-463f-babd-c56902460382 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:06.343095 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fe36fa0f-5638-463f-babd-c56902460382 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:06.402530 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fe36fa0f-5638-463f-babd-c56902460382 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 28645 microversion: 2.1 time: 0.072607 Nov 16 19:07:06.403172 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 314/649] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:06 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 28645 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:06.651195 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f8598c8a-c603-4ae0-b140-0d73ab3cf4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:06.651810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f8598c8a-c603-4ae0-b140-0d73ab3cf4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:06.658648 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f8598c8a-c603-4ae0-b140-0d73ab3cf4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:06.659095 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f8598c8a-c603-4ae0-b140-0d73ab3cf4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:06.659866 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f8598c8a-c603-4ae0-b140-0d73ab3cf4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:06.660296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f8598c8a-c603-4ae0-b140-0d73ab3cf4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:06.682877 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-f8598c8a-c603-4ae0-b140-0d73ab3cf4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lazy-loading 'flavor' on Instance uuid 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:07:06.931726 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f8598c8a-c603-4ae0-b140-0d73ab3cf4aa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 202 len: 0 microversion: 2.20 time: 0.284388 Nov 16 19:07:06.932538 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 336/650] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:07:06 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:07:06.941331 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:06.942145 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:06.948889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:06.949423 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:06.950436 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:06.950875 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:07.088175 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:07.095783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:07.097274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:07.098452 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-730a4521-a406-4fbd-b54e-2190146c51e2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.161638 Nov 16 19:07:07.098999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 315/651] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:06 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:07.414928 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f4a44d7f-c503-462c-a91d-f958b0564d34 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:07.415917 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f4a44d7f-c503-462c-a91d-f958b0564d34 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:07.422038 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f4a44d7f-c503-462c-a91d-f958b0564d34 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:07.422499 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f4a44d7f-c503-462c-a91d-f958b0564d34 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:07.423271 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f4a44d7f-c503-462c-a91d-f958b0564d34 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:07.423701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f4a44d7f-c503-462c-a91d-f958b0564d34 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:07.498308 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f4a44d7f-c503-462c-a91d-f958b0564d34 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 29378 microversion: 2.1 time: 0.088327 Nov 16 19:07:07.498920 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 337/652] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:07 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 29378 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:08.117618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:08.118238 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:08.124409 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:08.124849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:08.125637 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:08.126065 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:08.254423 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:08.262438 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:08.263916 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:08.265054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-04ec970a-e6ec-44b3-812c-ed2514bfe292 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.151214 Nov 16 19:07:08.265631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 316/653] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:08 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:08.511037 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8f6f294b-9206-4df0-a177-676a3ce0cf27 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:08.512035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8f6f294b-9206-4df0-a177-676a3ce0cf27 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:08.518814 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f6f294b-9206-4df0-a177-676a3ce0cf27 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:08.519258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f6f294b-9206-4df0-a177-676a3ce0cf27 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:08.520021 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f6f294b-9206-4df0-a177-676a3ce0cf27 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:08.520445 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f6f294b-9206-4df0-a177-676a3ce0cf27 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:08.599464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8f6f294b-9206-4df0-a177-676a3ce0cf27 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 31468 microversion: 2.1 time: 0.092882 Nov 16 19:07:08.600094 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 338/654] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:08 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 31468 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:09.284077 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:09.284637 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:09.291479 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:09.291926 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:09.292720 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:09.293150 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:09.419465 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:09.427057 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:09.428543 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:09.429713 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fc497565-1689-4d43-aa66-5fd0589a485d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.149397 Nov 16 19:07:09.430271 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 317/655] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:09 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:09.611237 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5a4e1cc7-7d86-4464-9710-7f136409f4d6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:09.612165 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5a4e1cc7-7d86-4464-9710-7f136409f4d6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:09.618987 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5a4e1cc7-7d86-4464-9710-7f136409f4d6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:09.619436 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5a4e1cc7-7d86-4464-9710-7f136409f4d6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:09.620208 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5a4e1cc7-7d86-4464-9710-7f136409f4d6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:09.620643 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5a4e1cc7-7d86-4464-9710-7f136409f4d6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:09.700649 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5a4e1cc7-7d86-4464-9710-7f136409f4d6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 33177 microversion: 2.1 time: 0.093412 Nov 16 19:07:09.701509 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 339/656] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:09 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 33177 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:10.448277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:10.448849 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:10.455071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:10.455513 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:10.456276 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:10.456707 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:10.585724 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:10.593423 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:10.594930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:10.596070 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7fa2801e-5bff-4510-b3d3-58dbb9bd2a39 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.152231 Nov 16 19:07:10.596625 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 318/657] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:10 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:10.712647 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b571ac12-907d-410f-a9c4-91eb812e4cf3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:10.713593 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b571ac12-907d-410f-a9c4-91eb812e4cf3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:10.720426 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b571ac12-907d-410f-a9c4-91eb812e4cf3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:10.720873 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b571ac12-907d-410f-a9c4-91eb812e4cf3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:10.721674 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b571ac12-907d-410f-a9c4-91eb812e4cf3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:10.722109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b571ac12-907d-410f-a9c4-91eb812e4cf3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:10.791202 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b571ac12-907d-410f-a9c4-91eb812e4cf3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 34214 microversion: 2.1 time: 0.082517 Nov 16 19:07:10.791801 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 340/658] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:10 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 34214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:11.614528 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:11.615041 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:11.621276 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:11.621759 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:11.622530 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:11.622960 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:11.749571 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:11.758095 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:11.759584 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:11.760734 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-985ba6ef-e235-45bf-a244-9129ebebe6ef tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.150001 Nov 16 19:07:11.761281 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 319/659] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:11 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:07:11.803605 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-651597a0-64a5-441e-b19d-0bef5668a9b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:11.805168 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-651597a0-64a5-441e-b19d-0bef5668a9b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:11.811897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-651597a0-64a5-441e-b19d-0bef5668a9b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:11.812336 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-651597a0-64a5-441e-b19d-0bef5668a9b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:11.813107 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-651597a0-64a5-441e-b19d-0bef5668a9b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:11.813532 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-651597a0-64a5-441e-b19d-0bef5668a9b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:11.884645 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-651597a0-64a5-441e-b19d-0bef5668a9b8 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 35230 microversion: 2.1 time: 0.084866 Nov 16 19:07:11.885275 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 341/660] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:11 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 35230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:12.779094 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:12.779720 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:12.786017 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:12.786444 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:12.787211 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:12.787638 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:12.896818 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fb1ba23a-52e7-424d-ba28-8b75ba97bdb6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:12.897987 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fb1ba23a-52e7-424d-ba28-8b75ba97bdb6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:12.904705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb1ba23a-52e7-424d-ba28-8b75ba97bdb6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:12.905157 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb1ba23a-52e7-424d-ba28-8b75ba97bdb6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:12.905960 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb1ba23a-52e7-424d-ba28-8b75ba97bdb6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:12.906396 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb1ba23a-52e7-424d-ba28-8b75ba97bdb6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:12.917507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:12.925178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:12.926704 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:12.927859 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ebc09a99-48e2-4398-9346-0944995f1826 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.152594 Nov 16 19:07:12.928415 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 320/661] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:12 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:12.978313 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fb1ba23a-52e7-424d-ba28-8b75ba97bdb6 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 36578 microversion: 2.1 time: 0.085467 Nov 16 19:07:12.978941 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 342/662] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:12 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 36578 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 19:07:13.947050 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:13.947680 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:13.954045 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:13.954495 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:13.955261 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:13.955689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:13.994354 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-542d998e-47e0-4ddd-a0ce-608cd2f7e888 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:13.995351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-542d998e-47e0-4ddd-a0ce-608cd2f7e888 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:14.002350 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-542d998e-47e0-4ddd-a0ce-608cd2f7e888 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:14.002801 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-542d998e-47e0-4ddd-a0ce-608cd2f7e888 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:14.003580 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-542d998e-47e0-4ddd-a0ce-608cd2f7e888 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:14.004274 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-542d998e-47e0-4ddd-a0ce-608cd2f7e888 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:14.079223 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-542d998e-47e0-4ddd-a0ce-608cd2f7e888 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 38106 microversion: 2.1 time: 0.089069 Nov 16 19:07:14.079789 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 343/663] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:13 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 38106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:14.084682 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:14.092918 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:14.094383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:14.095518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0214b205-2580-46d4-bd64-2d4bc15f9bfa tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.152844 Nov 16 19:07:14.096069 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 321/664] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:13 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:15.092231 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d73ca25b-5043-4a32-8ee9-b23fa38fd87e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:15.093232 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d73ca25b-5043-4a32-8ee9-b23fa38fd87e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:15.100042 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d73ca25b-5043-4a32-8ee9-b23fa38fd87e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:15.100495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d73ca25b-5043-4a32-8ee9-b23fa38fd87e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:15.101297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d73ca25b-5043-4a32-8ee9-b23fa38fd87e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:15.101765 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d73ca25b-5043-4a32-8ee9-b23fa38fd87e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:15.113892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:15.114493 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:15.120711 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:15.121154 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:15.121942 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:15.122375 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:15.175516 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d73ca25b-5043-4a32-8ee9-b23fa38fd87e tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 38180 microversion: 2.1 time: 0.087120 Nov 16 19:07:15.179715 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 344/665] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:15 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 38180 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:15.253921 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:15.262245 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:15.263779 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:15.264936 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-da57182c-840f-412e-82d4-78b02ecd118a tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.154654 Nov 16 19:07:15.265503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 322/666] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:15 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:07:16.186992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-55391da0-ab75-4eb9-84e7-66885f764a6a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:16.188026 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-55391da0-ab75-4eb9-84e7-66885f764a6a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:16.194826 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55391da0-ab75-4eb9-84e7-66885f764a6a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:16.195278 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55391da0-ab75-4eb9-84e7-66885f764a6a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:16.196053 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55391da0-ab75-4eb9-84e7-66885f764a6a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:16.196492 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55391da0-ab75-4eb9-84e7-66885f764a6a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:16.256690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-55391da0-ab75-4eb9-84e7-66885f764a6a tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 38180 microversion: 2.1 time: 0.073618 Nov 16 19:07:16.257593 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 345/667] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:16 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 38180 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:16.283166 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:16.283759 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:16.290611 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:16.291052 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:16.291804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:16.292259 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:16.423726 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:16.431487 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:16.432906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:16.434082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4004bb01-73c8-4103-b63c-f383ccc26f9c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.154547 Nov 16 19:07:16.434630 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 323/668] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:16 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:07:17.268794 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-62ba2691-b5ad-40c4-bcca-7329e38b5364 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:17.269942 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-62ba2691-b5ad-40c4-bcca-7329e38b5364 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:17.277399 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62ba2691-b5ad-40c4-bcca-7329e38b5364 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:17.277880 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62ba2691-b5ad-40c4-bcca-7329e38b5364 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:17.278652 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62ba2691-b5ad-40c4-bcca-7329e38b5364 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:17.279095 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62ba2691-b5ad-40c4-bcca-7329e38b5364 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:17.340981 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-62ba2691-b5ad-40c4-bcca-7329e38b5364 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 38180 microversion: 2.1 time: 0.075991 Nov 16 19:07:17.341945 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 346/669] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:17 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 38180 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:17.452677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:17.453286 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:17.459541 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:17.460642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:17.461414 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:17.461874 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:17.588697 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:17.596334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:17.597879 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:17.599031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cfe1a5a4-62c0-4008-a03d-250ba1415941 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1741 microversion: 2.20 time: 0.150150 Nov 16 19:07:17.599581 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 324/670] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:17 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:18.353238 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bfa5efc6-840f-49ed-96a8-b65a26d52963 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:18.354257 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bfa5efc6-840f-49ed-96a8-b65a26d52963 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:18.361058 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfa5efc6-840f-49ed-96a8-b65a26d52963 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:18.361503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfa5efc6-840f-49ed-96a8-b65a26d52963 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:18.362295 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfa5efc6-840f-49ed-96a8-b65a26d52963 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:18.362902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfa5efc6-840f-49ed-96a8-b65a26d52963 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:18.436712 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bfa5efc6-840f-49ed-96a8-b65a26d52963 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action" status: 200 len: 38311 microversion: 2.1 time: 0.087841 Nov 16 19:07:18.437240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 347/671] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:07:18 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/action => generated 38311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:18.446862 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1d7f689c-30c4-4160-8bbb-5282b465a287 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:18.447348 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1d7f689c-30c4-4160-8bbb-5282b465a287 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:18.453172 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d7f689c-30c4-4160-8bbb-5282b465a287 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:18.453775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d7f689c-30c4-4160-8bbb-5282b465a287 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:18.454402 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d7f689c-30c4-4160-8bbb-5282b465a287 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:18.454838 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1d7f689c-30c4-4160-8bbb-5282b465a287 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:18.478899 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1d7f689c-30c4-4160-8bbb-5282b465a287 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/ips" status: 200 len: 143 microversion: 2.1 time: 0.035712 Nov 16 19:07:18.479448 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 325/672] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 19:07:18 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/ips => generated 143 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:18.619053 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:18.620434 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:18.630476 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:18.631291 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:18.633369 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:18.633850 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:18.780199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:18.788266 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:18.789774 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:18.791027 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c053f967-0065-45cf-9a65-5742301f1ead tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1741 microversion: 2.20 time: 0.177095 Nov 16 19:07:18.791581 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 348/673] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:18 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:19.749671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-f0d93922-3ee6-4421-b29c-16462c2046fb req-e632a8f6-375b-48b6-9c87-fbe1aa2a69ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4", "name": "network-vif-plugged", "status": "completed", "tag": "5a94a757-e4b7-461b-a346-267538387bdf"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:19.752188 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:07:19.752188 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:07:19.761535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-f0d93922-3ee6-4421-b29c-16462c2046fb req-e632a8f6-375b-48b6-9c87-fbe1aa2a69ea service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:19.762301 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-f0d93922-3ee6-4421-b29c-16462c2046fb req-e632a8f6-375b-48b6-9c87-fbe1aa2a69ea service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:19.790124 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-f0d93922-3ee6-4421-b29c-16462c2046fb req-e632a8f6-375b-48b6-9c87-fbe1aa2a69ea service nova] Creating event network-vif-plugged:5a94a757-e4b7-461b-a346-267538387bdf for instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 on hv-cinder-66710 Nov 16 19:07:19.793076 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c8f5a2d3-dd39-4d07-af9d-e6549548745f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69ad37d6-46ee-4fc8-8348-ae3610685e60"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:19.794378 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c8f5a2d3-dd39-4d07-af9d-e6549548745f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:19.795662 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-f0d93922-3ee6-4421-b29c-16462c2046fb req-e632a8f6-375b-48b6-9c87-fbe1aa2a69ea service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115854 Nov 16 19:07:19.796307 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 326/674] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:07:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:19.801493 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c8f5a2d3-dd39-4d07-af9d-e6549548745f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:19.803053 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c8f5a2d3-dd39-4d07-af9d-e6549548745f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:19.803053 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c8f5a2d3-dd39-4d07-af9d-e6549548745f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:19.803234 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c8f5a2d3-dd39-4d07-af9d-e6549548745f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:19.809031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:19.809746 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:19.817744 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:19.818231 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:19.820015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:19.820643 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:19.967471 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:19.976881 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:19.978572 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:19.979751 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-23f14382-4120-40ac-8860-594ae4d3d978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1736 microversion: 2.20 time: 0.174633 Nov 16 19:07:19.980311 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 327/675] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:19 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:20.051592 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c8f5a2d3-dd39-4d07-af9d-e6549548745f tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262566 Nov 16 19:07:20.052249 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 349/676] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:07:19 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:20.998652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:20.999252 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:21.007435 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:21.008166 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:21.008984 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:21.009416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:21.157383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:21.169837 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:21.171325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:21.172497 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-931ad665-1bbe-4fc6-b03e-04a341051179 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1736 microversion: 2.20 time: 0.177649 Nov 16 19:07:21.173048 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 328/677] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:20 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:22.192017 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:22.192797 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:22.199726 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:22.200497 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:22.201480 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:22.202159 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:22.376178 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:22.385008 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:22.386806 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:22.388094 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f6349b30-132c-40f1-b3fa-43bb151b7c57 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1736 microversion: 2.20 time: 0.200906 Nov 16 19:07:22.388733 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 350/678] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:22 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:23.406778 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:23.407393 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:23.415172 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:23.416160 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:23.417502 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:23.418083 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:23.571066 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:23.579283 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:23.581017 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:23.582207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5b7e3dc3-ba1a-428f-b1ef-a5e5f5b6c70c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1736 microversion: 2.20 time: 0.179176 Nov 16 19:07:23.582755 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 329/679] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:23 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:07:24.602803 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:24.603992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:24.610491 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:24.611141 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:24.612106 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:24.612726 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:24.760487 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:24.772997 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:24.775273 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:24.776495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e71589a9-2d75-460b-b875-0e7b9ce43ac4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1736 microversion: 2.20 time: 0.179271 Nov 16 19:07:24.787998 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 351/680] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:24 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:25.794799 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:25.795536 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:25.802703 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:25.803143 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:25.804131 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:25.804633 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:25.951181 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:25.967021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:25.968509 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:25.969704 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fbb80b8a-9a8a-439a-a6ed-2934fd7ccf65 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1736 microversion: 2.20 time: 0.178592 Nov 16 19:07:25.973613 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 330/681] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:25 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:26.558620 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-df3fb54e-bf3d-4637-b67f-b4cfead77bd0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:26.559758 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-df3fb54e-bf3d-4637-b67f-b4cfead77bd0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:26.566364 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df3fb54e-bf3d-4637-b67f-b4cfead77bd0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:26.566917 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df3fb54e-bf3d-4637-b67f-b4cfead77bd0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:26.567773 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df3fb54e-bf3d-4637-b67f-b4cfead77bd0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:26.568247 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df3fb54e-bf3d-4637-b67f-b4cfead77bd0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:26.604354 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-df3fb54e-bf3d-4637-b67f-b4cfead77bd0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049519 Nov 16 19:07:26.605085 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 352/682] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:07:26 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:26.614563 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6d5e1391-0913-4793-ba6b-8213961e28ce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:26.616226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6d5e1391-0913-4793-ba6b-8213961e28ce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:26.623198 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6d5e1391-0913-4793-ba6b-8213961e28ce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:26.623789 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6d5e1391-0913-4793-ba6b-8213961e28ce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:26.624646 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6d5e1391-0913-4793-ba6b-8213961e28ce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:26.625172 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6d5e1391-0913-4793-ba6b-8213961e28ce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:26.659201 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6d5e1391-0913-4793-ba6b-8213961e28ce tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/69ad37d6-46ee-4fc8-8348-ae3610685e60" status: 200 len: 194 microversion: 2.1 time: 0.048282 Nov 16 19:07:26.660082 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 331/683] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 16 19:07:26 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/69ad37d6-46ee-4fc8-8348-ae3610685e60 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:26.988666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:26.989267 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:26.997465 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:26.997939 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:27.007465 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:27.007985 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:27.163951 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:27.172714 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:27.174308 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:27.175535 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f9a4ca3d-1a0e-4911-b27a-527eaf726bd4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1736 microversion: 2.20 time: 0.191154 Nov 16 19:07:27.176499 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 353/684] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:26 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:28.030146 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-227e0b22-fc86-4409-b709-850301135307 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74182f17-3252-427f-b7b1-f5ad11649c87"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:28.031234 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-227e0b22-fc86-4409-b709-850301135307 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:28.038379 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-227e0b22-fc86-4409-b709-850301135307 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:28.038834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-227e0b22-fc86-4409-b709-850301135307 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:28.039631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-227e0b22-fc86-4409-b709-850301135307 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:28.040071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-227e0b22-fc86-4409-b709-850301135307 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:28.196705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:28.197787 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:28.203993 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:28.204437 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:28.205212 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:28.205673 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:28.388891 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-227e0b22-fc86-4409-b709-850301135307 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362411 Nov 16 19:07:28.389999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 332/685] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:07:28 2021] POST /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:28.393700 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:28.409462 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:28.412220 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:28.413610 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-636c8cf7-0b81-4432-83d5-90fe173a7714 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1736 microversion: 2.20 time: 0.221425 Nov 16 19:07:28.414485 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 354/686] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:28 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:07:29.432749 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:29.433489 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:29.439560 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:29.440011 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:29.440784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:29.441218 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:29.644094 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:29.652242 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:29.653769 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:29.654978 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5fd960e4-1fb3-4039-a651-2e870edb54f5 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1718 microversion: 2.20 time: 0.226920 Nov 16 19:07:29.655531 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 333/687] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:29 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1718 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:30.673075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:30.673701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:30.680359 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:30.680803 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:30.681585 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:30.682013 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:30.808480 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:30.815997 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:30.817484 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:30.818808 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-55ca3e20-51de-4615-8760-6eb4b89753bc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1718 microversion: 2.20 time: 0.149382 Nov 16 19:07:30.819406 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 355/688] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:30 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:31.680867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-38044d76-8876-4ad1-a94b-6b86b5a9a4bf req-c780514c-902d-4c8f-a862-7e88000fed9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4", "name": "network-vif-unplugged", "status": "completed", "tag": "5a94a757-e4b7-461b-a346-267538387bdf"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:31.682504 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:07:31.682504 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:07:31.690218 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-38044d76-8876-4ad1-a94b-6b86b5a9a4bf req-c780514c-902d-4c8f-a862-7e88000fed9b service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:31.690666 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-38044d76-8876-4ad1-a94b-6b86b5a9a4bf req-c780514c-902d-4c8f-a862-7e88000fed9b service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:31.703125 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-38044d76-8876-4ad1-a94b-6b86b5a9a4bf req-c780514c-902d-4c8f-a862-7e88000fed9b service nova] Creating event network-vif-unplugged:5a94a757-e4b7-461b-a346-267538387bdf for instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 on hv-cinder-66710 Nov 16 19:07:31.707751 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-38044d76-8876-4ad1-a94b-6b86b5a9a4bf req-c780514c-902d-4c8f-a862-7e88000fed9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031248 Nov 16 19:07:31.708363 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 334/689] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:07:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:31.836589 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:31.837314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:31.843967 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:31.844505 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:31.845367 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:31.845912 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:31.982659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:31.990030 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:31.991594 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:31.992819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f78276f9-dd3d-4465-bf30-771908e3e1fc tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1721 microversion: 2.20 time: 0.159908 Nov 16 19:07:31.993288 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 356/690] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:31 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:32.014814 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bcee3746-3b52-4a48-9dac-cc006a57f653 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff162f08-4caa-491d-9844-d3ee0ff38481"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:32.015984 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bcee3746-3b52-4a48-9dac-cc006a57f653 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:32.026651 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bcee3746-3b52-4a48-9dac-cc006a57f653 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:32.027105 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bcee3746-3b52-4a48-9dac-cc006a57f653 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:32.027886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bcee3746-3b52-4a48-9dac-cc006a57f653 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:32.028316 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bcee3746-3b52-4a48-9dac-cc006a57f653 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:32.296455 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bcee3746-3b52-4a48-9dac-cc006a57f653 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285920 Nov 16 19:07:32.297156 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 335/691] 10.222.0.46 () {62 vars in 1363 bytes} [Tue Nov 16 19:07:32 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 19:07:32.410897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-837f93bf-b5ab-4f0f-b54c-f813c0a70ae2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:32.411382 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-837f93bf-b5ab-4f0f-b54c-f813c0a70ae2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:32.419906 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-837f93bf-b5ab-4f0f-b54c-f813c0a70ae2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:32.420348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-837f93bf-b5ab-4f0f-b54c-f813c0a70ae2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:32.421117 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-837f93bf-b5ab-4f0f-b54c-f813c0a70ae2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:32.421565 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-837f93bf-b5ab-4f0f-b54c-f813c0a70ae2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:32.645862 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-837f93bf-b5ab-4f0f-b54c-f813c0a70ae2 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "DELETE /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/os-volume_attachments/ff162f08-4caa-491d-9844-d3ee0ff38481" status: 202 len: 0 microversion: 2.20 time: 0.238806 Nov 16 19:07:32.646451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 357/692] 10.222.0.46 () {60 vars in 1456 bytes} [Tue Nov 16 19:07:32 2021] DELETE /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/os-volume_attachments/ff162f08-4caa-491d-9844-d3ee0ff38481 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:07:32.699282 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e9bc0cee-092f-4726-8fa1-4385938caf43 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:32.699952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e9bc0cee-092f-4726-8fa1-4385938caf43 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:32.705892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e9bc0cee-092f-4726-8fa1-4385938caf43 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:32.706253 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e9bc0cee-092f-4726-8fa1-4385938caf43 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:32.707017 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e9bc0cee-092f-4726-8fa1-4385938caf43 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:32.707447 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e9bc0cee-092f-4726-8fa1-4385938caf43 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:32.795279 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e9bc0cee-092f-4726-8fa1-4385938caf43 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action" status: 202 len: 0 microversion: 2.20 time: 0.099684 Nov 16 19:07:32.795966 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 336/693] 10.222.0.46 () {62 vars in 1318 bytes} [Tue Nov 16 19:07:32 2021] POST /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 16 19:07:32.804235 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:32.804833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:32.811142 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:32.811586 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:32.812355 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:32.812779 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:32.968660 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:32.976247 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:32.977938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:32.979088 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fc79e600-debe-4a02-a7ca-4ce27e857978 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1669 microversion: 2.20 time: 0.179040 Nov 16 19:07:32.979643 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 358/694] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:32 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1669 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:34.053329 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:34.053964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:34.059748 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:34.060192 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:34.060966 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:34.061395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:34.374452 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:34.383249 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:34.384743 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:34.385993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c89e11d3-227f-4229-9d8d-0fea2b4d4027 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.390589 Nov 16 19:07:34.386511 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 337/695] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:33 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:35.405303 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:35.407139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:35.416033 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:35.417139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:35.418786 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:35.419747 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:35.595301 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:35.605012 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:35.606848 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:35.608203 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1a4818b2-c705-4746-8105-2b2c0b7dcb5b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.207371 Nov 16 19:07:35.609242 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 359/696] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:35 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:35.898713 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-68019457-86b6-40b5-b47d-acfd4dbb473c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:35.900335 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-68019457-86b6-40b5-b47d-acfd4dbb473c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:35.906882 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68019457-86b6-40b5-b47d-acfd4dbb473c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:35.907565 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68019457-86b6-40b5-b47d-acfd4dbb473c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:35.908344 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68019457-86b6-40b5-b47d-acfd4dbb473c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:35.908777 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68019457-86b6-40b5-b47d-acfd4dbb473c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:35.944300 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-68019457-86b6-40b5-b47d-acfd4dbb473c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049802 Nov 16 19:07:35.944867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 338/697] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:07:35 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:36.207944 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-957bdec7-e6c1-45df-adcc-fffc582849de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:36.208720 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-957bdec7-e6c1-45df-adcc-fffc582849de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:36.226523 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-957bdec7-e6c1-45df-adcc-fffc582849de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:36.226973 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-957bdec7-e6c1-45df-adcc-fffc582849de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:36.227758 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-957bdec7-e6c1-45df-adcc-fffc582849de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:36.228189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-957bdec7-e6c1-45df-adcc-fffc582849de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:36.263738 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-957bdec7-e6c1-45df-adcc-fffc582849de tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/69ad37d6-46ee-4fc8-8348-ae3610685e60" status: 200 len: 194 microversion: 2.1 time: 0.059484 Nov 16 19:07:36.264364 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 360/698] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 16 19:07:36 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/69ad37d6-46ee-4fc8-8348-ae3610685e60 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:36.274993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fb5c88b7-b1d9-4724-b0d5-2d960f67cf3c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:36.275462 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fb5c88b7-b1d9-4724-b0d5-2d960f67cf3c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:36.281215 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb5c88b7-b1d9-4724-b0d5-2d960f67cf3c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:36.281687 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb5c88b7-b1d9-4724-b0d5-2d960f67cf3c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:36.282451 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb5c88b7-b1d9-4724-b0d5-2d960f67cf3c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:36.282880 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb5c88b7-b1d9-4724-b0d5-2d960f67cf3c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:36.358627 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-fb5c88b7-b1d9-4724-b0d5-2d960f67cf3c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lazy-loading 'services' on Instance uuid 9fa66316-7216-4224-92a2-7280db37d232 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:07:36.457245 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fb5c88b7-b1d9-4724-b0d5-2d960f67cf3c tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/69ad37d6-46ee-4fc8-8348-ae3610685e60" status: 202 len: 0 microversion: 2.1 time: 0.186430 Nov 16 19:07:36.458024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 339/699] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:07:36 2021] DELETE /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/69ad37d6-46ee-4fc8-8348-ae3610685e60 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:07:36.629386 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:36.630020 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:36.637112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:36.637523 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:36.638341 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:36.638778 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:36.771211 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:36.779132 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:36.780654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:36.781874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-505087cc-b005-4e49-91c6-8ff5e14e5dc1 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.156473 Nov 16 19:07:36.782605 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 361/700] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:36 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:37.801504 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:37.802320 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:37.809059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:37.809505 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:37.810304 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:37.810735 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:37.942621 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:37.950087 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:37.951558 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:37.952690 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b6ca2f94-5a2b-4681-af2f-bf16c6d84ad3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.155777 Nov 16 19:07:37.953240 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 340/701] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:37 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:38.971681 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:38.972285 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:38.979032 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:38.979478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:38.980253 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:38.980684 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:39.110904 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:39.119064 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:39.120554 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:39.121720 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6e34457c-7afc-4afb-94dc-3b848752ad1b tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.153679 Nov 16 19:07:39.122270 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 362/702] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:38 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:40.140272 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:40.140871 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:40.147184 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:40.147644 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:40.148416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:40.148848 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:40.284224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:40.293595 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:40.295083 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:40.296275 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9ad70e8b-72cf-4b8f-845f-e72fbf5f0bde tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.160038 Nov 16 19:07:40.297204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 341/703] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:40 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:41.314744 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:41.315322 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:41.322127 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:41.322573 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:41.323334 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:41.323763 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:41.457175 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:41.467789 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:41.469324 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:41.470521 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3978c669-d620-48dd-bfd9-52b4beaf48a8 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.159438 Nov 16 19:07:41.471074 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 363/704] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:41 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:42.488724 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:42.489332 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:42.496204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:42.496645 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:42.497414 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:42.497869 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:42.626018 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:42.634540 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:42.636022 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:42.637199 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-99c0ce89-1a96-43bf-9467-b0d646e9afb3 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.152281 Nov 16 19:07:42.637773 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 342/705] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:42 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:43.655246 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:43.656686 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:43.663801 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:43.664611 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:43.665657 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:43.666322 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:43.795427 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:43.805237 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:43.807050 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:43.808620 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b03ef1f0-edc6-4ff1-84a2-a7faa106fd82 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.157079 Nov 16 19:07:43.819963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 364/706] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:43 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:44.827921 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:44.828568 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:44.834781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:44.835224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:44.835989 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:44.836413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:44.978618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:44.986353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:44.987847 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:44.988994 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bd3287f5-6612-44c8-a807-352714428639 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.164880 Nov 16 19:07:44.989568 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 343/707] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:44 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:46.008993 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:46.009706 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:46.016904 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:46.017512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:46.018378 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:46.018893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:46.154247 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:46.162302 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:46.164544 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:46.165833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-12969e37-e481-465e-a1f0-d8078c877b76 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.161566 Nov 16 19:07:46.166743 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 365/708] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:46 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:47.185424 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:47.186072 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:47.192204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:47.192645 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:47.193407 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:47.194492 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:47.339383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:47.348364 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:47.350418 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:47.351615 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-158444db-15be-47e4-820a-3106ab2bdaf6 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.169863 Nov 16 19:07:47.352160 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 344/709] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:47 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:48.370033 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:48.370669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:48.376833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:48.377272 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:48.378059 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:48.378755 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:48.507154 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:48.514634 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:48.516109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:48.517241 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-53ddb357-e601-48e2-97d6-e22ddb943e55 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.150924 Nov 16 19:07:48.517822 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 366/710] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:48 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:49.152322 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6374a0ec-00a4-4c74-8648-425bbb4215b4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:49.152864 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6374a0ec-00a4-4c74-8648-425bbb4215b4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:49.159118 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6374a0ec-00a4-4c74-8648-425bbb4215b4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:49.159568 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6374a0ec-00a4-4c74-8648-425bbb4215b4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:49.160404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6374a0ec-00a4-4c74-8648-425bbb4215b4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:49.160838 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6374a0ec-00a4-4c74-8648-425bbb4215b4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:49.189148 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6374a0ec-00a4-4c74-8648-425bbb4215b4 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/74182f17-3252-427f-b7b1-f5ad11649c87" status: 200 len: 194 microversion: 2.1 time: 0.040849 Nov 16 19:07:49.189758 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 345/711] 10.222.0.46 () {58 vars in 1412 bytes} [Tue Nov 16 19:07:49 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/74182f17-3252-427f-b7b1-f5ad11649c87 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:49.199127 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d2cef171-84ee-4079-b3a3-99595ec3638d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:49.199618 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d2cef171-84ee-4079-b3a3-99595ec3638d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:49.205339 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d2cef171-84ee-4079-b3a3-99595ec3638d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:49.205818 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d2cef171-84ee-4079-b3a3-99595ec3638d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:49.206594 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d2cef171-84ee-4079-b3a3-99595ec3638d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:49.207026 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d2cef171-84ee-4079-b3a3-99595ec3638d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:49.286204 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-d2cef171-84ee-4079-b3a3-99595ec3638d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lazy-loading 'services' on Instance uuid 9fa66316-7216-4224-92a2-7280db37d232 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:07:49.362912 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d2cef171-84ee-4079-b3a3-99595ec3638d tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/74182f17-3252-427f-b7b1-f5ad11649c87" status: 202 len: 0 microversion: 2.1 time: 0.166932 Nov 16 19:07:49.363641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 367/712] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:07:49 2021] DELETE /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments/74182f17-3252-427f-b7b1-f5ad11649c87 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:07:49.534899 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:49.535504 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:49.541357 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:49.541834 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:49.542597 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:49.543031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:49.671108 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:49.678951 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:49.680503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:49.681694 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2f8271a6-7625-4327-acbc-5d4593f76f2d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.150424 Nov 16 19:07:49.682251 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 346/713] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:49 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:50.514690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0264b834-fa88-4f42-8562-b7de298d97d3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:50.515750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0264b834-fa88-4f42-8562-b7de298d97d3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:50.521742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0264b834-fa88-4f42-8562-b7de298d97d3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.522189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0264b834-fa88-4f42-8562-b7de298d97d3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.522956 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0264b834-fa88-4f42-8562-b7de298d97d3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.523387 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0264b834-fa88-4f42-8562-b7de298d97d3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.551125 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0264b834-fa88-4f42-8562-b7de298d97d3 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040977 Nov 16 19:07:50.551665 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 368/714] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:07:50 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:07:50.649076 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cbe63994-b1ca-40e9-8f11-ba214025fb56 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:50.650015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cbe63994-b1ca-40e9-8f11-ba214025fb56 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:50.656180 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbe63994-b1ca-40e9-8f11-ba214025fb56 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.656627 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbe63994-b1ca-40e9-8f11-ba214025fb56 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.657395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbe63994-b1ca-40e9-8f11-ba214025fb56 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.657860 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbe63994-b1ca-40e9-8f11-ba214025fb56 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.690280 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cbe63994-b1ca-40e9-8f11-ba214025fb56 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045404 Nov 16 19:07:50.690835 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 347/715] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:07:50 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:07:50.700007 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:50.700585 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:50.706591 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.706968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.707751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.708167 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.745441 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8456daa6-1fa0-4660-844c-d877fddd3eae tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:50.746079 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8456daa6-1fa0-4660-844c-d877fddd3eae tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:50.752245 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8456daa6-1fa0-4660-844c-d877fddd3eae tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.752697 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8456daa6-1fa0-4660-844c-d877fddd3eae tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.753772 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8456daa6-1fa0-4660-844c-d877fddd3eae tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.754215 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8456daa6-1fa0-4660-844c-d877fddd3eae tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.778975 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8456daa6-1fa0-4660-844c-d877fddd3eae tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:07:50.844362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:50.855674 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8456daa6-1fa0-4660-844c-d877fddd3eae tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 204 len: 0 microversion: 2.1 time: 0.113544 Nov 16 19:07:50.856565 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 348/716] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:07:50 2021] DELETE /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 19:07:50.861192 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:50.863169 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:50.864502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-65aa4e68-8e06-4ffd-8964-8a1004efffff tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.168316 Nov 16 19:07:50.865085 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c5c0b84b-cd9c-457a-bcf8-f4a97d2b8bfa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:50.865258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 369/717] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:50 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:50.865835 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c5c0b84b-cd9c-457a-bcf8-f4a97d2b8bfa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:50.871515 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c5c0b84b-cd9c-457a-bcf8-f4a97d2b8bfa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.871985 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c5c0b84b-cd9c-457a-bcf8-f4a97d2b8bfa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:50.872745 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c5c0b84b-cd9c-457a-bcf8-f4a97d2b8bfa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:50.873171 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c5c0b84b-cd9c-457a-bcf8-f4a97d2b8bfa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:51.003964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c5c0b84b-cd9c-457a-bcf8-f4a97d2b8bfa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:51.011640 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c5c0b84b-cd9c-457a-bcf8-f4a97d2b8bfa tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1670 microversion: 2.1 time: 0.150565 Nov 16 19:07:51.012213 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 349/718] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:07:50 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:07:51.796384 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-8553e63f-e435-4fcb-bdfa-c202879e1ef6 req-0c6766f8-b43c-4be3-a96f-edc2a657b097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4", "name": "network-vif-plugged", "status": "completed", "tag": "5a94a757-e4b7-461b-a346-267538387bdf"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:51.798032 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:07:51.798032 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:07:51.806402 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8553e63f-e435-4fcb-bdfa-c202879e1ef6 req-0c6766f8-b43c-4be3-a96f-edc2a657b097 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:51.806848 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8553e63f-e435-4fcb-bdfa-c202879e1ef6 req-0c6766f8-b43c-4be3-a96f-edc2a657b097 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:51.819123 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-8553e63f-e435-4fcb-bdfa-c202879e1ef6 req-0c6766f8-b43c-4be3-a96f-edc2a657b097 service nova] Creating event network-vif-plugged:5a94a757-e4b7-461b-a346-267538387bdf for instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 on hv-cinder-66710 Nov 16 19:07:51.823830 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-8553e63f-e435-4fcb-bdfa-c202879e1ef6 req-0c6766f8-b43c-4be3-a96f-edc2a657b097 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031319 Nov 16 19:07:51.824429 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 370/719] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:07:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:51.883254 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:51.883881 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:51.890764 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:51.891149 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:51.891933 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:51.892368 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:52.028458 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-28c4ddb4-8f39-433f-ad0a-64d29a756b16 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:52.029185 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-28c4ddb4-8f39-433f-ad0a-64d29a756b16 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:52.035148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28c4ddb4-8f39-433f-ad0a-64d29a756b16 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:52.035601 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28c4ddb4-8f39-433f-ad0a-64d29a756b16 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:52.036385 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28c4ddb4-8f39-433f-ad0a-64d29a756b16 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:52.036828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28c4ddb4-8f39-433f-ad0a-64d29a756b16 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:52.048623 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:52.057092 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:52.058620 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:52.059767 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e5e972eb-51e3-472a-885d-8fddcba40ecd tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.180318 Nov 16 19:07:52.060318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 350/720] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:51 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:52.168432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-28c4ddb4-8f39-433f-ad0a-64d29a756b16 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:52.175835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-28c4ddb4-8f39-433f-ad0a-64d29a756b16 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1670 microversion: 2.1 time: 0.151353 Nov 16 19:07:52.176417 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 371/721] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:07:52 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:07:53.077846 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:53.078448 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:53.084582 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:53.085021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:53.085935 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:53.086364 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:53.192554 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9d1b6881-cb90-471b-81db-8d203c745c01 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:53.193090 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9d1b6881-cb90-471b-81db-8d203c745c01 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:53.199852 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d1b6881-cb90-471b-81db-8d203c745c01 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:53.200289 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d1b6881-cb90-471b-81db-8d203c745c01 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:53.201061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d1b6881-cb90-471b-81db-8d203c745c01 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:53.201491 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d1b6881-cb90-471b-81db-8d203c745c01 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:53.336412 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9d1b6881-cb90-471b-81db-8d203c745c01 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047420b1d0b84633af129ecb0ac468ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836db18eadf842ce90dda0a1221006ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:53.345693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:53.348714 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9d1b6881-cb90-471b-81db-8d203c745c01 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 200 len: 1670 microversion: 2.1 time: 0.159548 Nov 16 19:07:53.350348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 372/722] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:07:53 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:07:53.363652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:53.370546 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:53.371764 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4be6fd45-91b3-464e-bf8a-a8d863238257 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1727 microversion: 2.20 time: 0.297601 Nov 16 19:07:53.383156 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 351/723] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:53 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1727 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:07:53.894590 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-b66920a7-2b7b-4210-addf-c9ea1dc50332 req-56d50fa6-7bd7-4f9c-a03a-299228d98377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa66316-7216-4224-92a2-7280db37d232", "name": "network-vif-deleted", "tag": "2e45e72d-543c-4ccf-ae9c-db23235939c9"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:07:53.896190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:07:53.896190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:07:53.909731 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-b66920a7-2b7b-4210-addf-c9ea1dc50332 req-56d50fa6-7bd7-4f9c-a03a-299228d98377 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:53.910785 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-b66920a7-2b7b-4210-addf-c9ea1dc50332 req-56d50fa6-7bd7-4f9c-a03a-299228d98377 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:53.933915 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-b66920a7-2b7b-4210-addf-c9ea1dc50332 req-56d50fa6-7bd7-4f9c-a03a-299228d98377 service nova] Creating event network-vif-deleted:2e45e72d-543c-4ccf-ae9c-db23235939c9 for instance 9fa66316-7216-4224-92a2-7280db37d232 on hv-cinder-66710 Nov 16 19:07:53.941395 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-b66920a7-2b7b-4210-addf-c9ea1dc50332 req-56d50fa6-7bd7-4f9c-a03a-299228d98377 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122746 Nov 16 19:07:53.942133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 373/724] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:07:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:07:54.367758 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:54.368443 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:54.375115 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:54.375653 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:54.376693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:54.377219 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:54.391517 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:54.393121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:54.393846 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] HTTP exception thrown: Instance 9fa66316-7216-4224-92a2-7280db37d232 could not be found. Nov 16 19:07:54.394524 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Returning 404 to user: Instance 9fa66316-7216-4224-92a2-7280db37d232 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:07:54.395432 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-920ee12c-6dcc-413f-9fad-4c5c8e8ccad5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 404 len: 111 microversion: 2.1 time: 0.032780 Nov 16 19:07:54.396062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 352/725] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:07:54 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:07:54.400146 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:54.400599 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:54.401388 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:54.401843 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:54.406411 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-594a6f2e-e6b9-4285-b9cf-c6ef591402f5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '.version_select at 0x7ffa56d26a60>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:54.428410 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-594a6f2e-e6b9-4285-b9cf-c6ef591402f5 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-781586712" status: 202 len: 0 microversion: 2.1 time: 0.025080 Nov 16 19:07:54.429412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 353/726] 10.222.0.46 () {58 vars in 1217 bytes} [Tue Nov 16 19:07:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-781586712 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:07:54.555016 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:54.565063 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:54.566833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:07:54.569432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-25144883-f3f1-4a7d-86a2-a3d7e32ecd95 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1714 microversion: 2.20 time: 0.182687 Nov 16 19:07:54.570257 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 374/727] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:07:54 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1714 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 19:07:57.328893 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:57.329407 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:57.335409 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:57.335846 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:57.336618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:57.337051 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:57.350879 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] HTTP exception thrown: Instance 9fa66316-7216-4224-92a2-7280db37d232 could not be found. Nov 16 19:07:57.351466 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Returning 404 to user: Instance 9fa66316-7216-4224-92a2-7280db37d232 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:07:57.352282 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-de0df15e-50f0-4a41-96db-576973bdbb82 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 404 len: 111 microversion: 2.1 time: 0.027561 Nov 16 19:07:57.352815 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 354/728] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:07:57 2021] DELETE /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:07:57.360453 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:57.361058 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 9fa66316-7216-4224-92a2-7280db37d232] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:57.368009 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:57.368451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:57.369215 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:57.369690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:57.383579 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] HTTP exception thrown: Instance 9fa66316-7216-4224-92a2-7280db37d232 could not be found. Nov 16 19:07:57.384154 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Returning 404 to user: Instance 9fa66316-7216-4224-92a2-7280db37d232 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:07:57.384958 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-777b50e3-d2b5-4620-b313-2d4cd0369972 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232" status: 404 len: 111 microversion: 2.1 time: 0.028143 Nov 16 19:07:57.385478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 375/729] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:07:57 2021] GET /compute/v2.1/servers/9fa66316-7216-4224-92a2-7280db37d232 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:07:58.508426 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:58.508914 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:58.515033 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:58.515476 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:58.516228 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:58.516659 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:58.529318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] HTTP exception thrown: Instance 7190b8e5-4def-4b46-bf21-dae43664c0ad could not be found. Nov 16 19:07:58.529918 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Returning 404 to user: Instance 7190b8e5-4def-4b46-bf21-dae43664c0ad could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:07:58.530705 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-47a4d47d-ecfa-4236-bdc3-f7400a903a3b tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 404 len: 111 microversion: 2.1 time: 0.025981 Nov 16 19:07:58.531207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 355/730] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:07:58 2021] DELETE /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:07:58.539356 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:07:58.539970 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] [instance: 7190b8e5-4def-4b46-bf21-dae43664c0ad] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:07:58.545705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:58.546158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:58.546964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:07:58.547402 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:07:58.560838 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] HTTP exception thrown: Instance 7190b8e5-4def-4b46-bf21-dae43664c0ad could not be found. Nov 16 19:07:58.561451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] Returning 404 to user: Instance 7190b8e5-4def-4b46-bf21-dae43664c0ad could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:07:58.562289 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ff674f81-c09e-4f94-8346-b5b1ae6ab5d0 tempest-AttachVolumeTestJSON-1587830937 tempest-AttachVolumeTestJSON-1587830937-project] 10.222.0.46 "GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad" status: 404 len: 111 microversion: 2.1 time: 0.027318 Nov 16 19:07:58.562805 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 376/731] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:07:58 2021] GET /compute/v2.1/servers/7190b8e5-4def-4b46-bf21-dae43664c0ad => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:08:03.661671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1469303196", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "e621ec68-f159-4652-a7d6-6091f1908e3b"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:03.712268 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] validate_networks() for [('e621ec68-f159-4652-a7d6-6091f1908e3b', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:08:04.043985 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:08:04.044401 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:08:04.044869 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:08:04.045271 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:08:04.045708 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:08:04.054737 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:04.055181 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:04.055981 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:04.056411 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:04.072005 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Getting quotas for project 94b91bcf959046d98ee0e24ab094216b. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:08:04.075881 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Getting quotas for user 846d3005576a460cba07a39ee8596699 and project 94b91bcf959046d98ee0e24ab094216b. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:08:04.086279 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:08:04.088533 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:08:04.133490 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-df39fb41-dcac-4dad-8bfb-7fd0385dc685 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583372 Nov 16 19:08:04.134178 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 356/732] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:08:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:08:04.143794 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-563f4a1f-e74c-45ac-8527-a02255ff0c48 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:04.144474 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-563f4a1f-e74c-45ac-8527-a02255ff0c48 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:04.194963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-563f4a1f-e74c-45ac-8527-a02255ff0c48 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:04.201362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-563f4a1f-e74c-45ac-8527-a02255ff0c48 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1218 microversion: 2.1 time: 0.061160 Nov 16 19:08:04.201997 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 377/733] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:04 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:05.219579 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-795cd41e-5b8c-4db6-bb7d-e1a1ca43d16f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:05.220226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-795cd41e-5b8c-4db6-bb7d-e1a1ca43d16f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:05.226665 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-795cd41e-5b8c-4db6-bb7d-e1a1ca43d16f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:05.227085 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-795cd41e-5b8c-4db6-bb7d-e1a1ca43d16f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:05.227854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-795cd41e-5b8c-4db6-bb7d-e1a1ca43d16f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:05.228277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-795cd41e-5b8c-4db6-bb7d-e1a1ca43d16f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:05.315728 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-795cd41e-5b8c-4db6-bb7d-e1a1ca43d16f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:05.323168 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-795cd41e-5b8c-4db6-bb7d-e1a1ca43d16f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1276 microversion: 2.1 time: 0.108145 Nov 16 19:08:05.323822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 357/734] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:05 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:06.340455 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-08d76810-1b4d-4614-a359-404fb38cb84f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:06.341149 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-08d76810-1b4d-4614-a359-404fb38cb84f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:06.348290 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08d76810-1b4d-4614-a359-404fb38cb84f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:06.348791 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08d76810-1b4d-4614-a359-404fb38cb84f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:06.349681 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08d76810-1b4d-4614-a359-404fb38cb84f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:06.350141 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08d76810-1b4d-4614-a359-404fb38cb84f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:06.364058 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-7cfd9706-8b51-40f3-9a57-fbc25bac267c req-d4086241-4439-4f30-8087-7bd8710c9dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e52ea22-a91d-49af-bb25-1b1d20df5768", "tag": "8e5b3f73-ec0e-4a71-9000-d46d548d6adf"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:06.366582 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:08:06.366582 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:08:06.374333 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-7cfd9706-8b51-40f3-9a57-fbc25bac267c req-d4086241-4439-4f30-8087-7bd8710c9dab service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:06.375008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-7cfd9706-8b51-40f3-9a57-fbc25bac267c req-d4086241-4439-4f30-8087-7bd8710c9dab service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:06.388090 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-7cfd9706-8b51-40f3-9a57-fbc25bac267c req-d4086241-4439-4f30-8087-7bd8710c9dab service nova] Creating event network-changed:8e5b3f73-ec0e-4a71-9000-d46d548d6adf for instance 0e52ea22-a91d-49af-bb25-1b1d20df5768 on hv-cinder-66710 Nov 16 19:08:06.393334 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-7cfd9706-8b51-40f3-9a57-fbc25bac267c req-d4086241-4439-4f30-8087-7bd8710c9dab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036247 Nov 16 19:08:06.394393 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 358/735] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:08:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:08:06.488939 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-08d76810-1b4d-4614-a359-404fb38cb84f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:06.496524 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-08d76810-1b4d-4614-a359-404fb38cb84f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1318 microversion: 2.1 time: 0.159707 Nov 16 19:08:06.497077 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 378/736] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:06 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:07.515065 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-01128417-84f0-4e42-8972-bac276f5726a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:07.515671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-01128417-84f0-4e42-8972-bac276f5726a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:07.521695 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01128417-84f0-4e42-8972-bac276f5726a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:07.522135 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01128417-84f0-4e42-8972-bac276f5726a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:07.522891 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01128417-84f0-4e42-8972-bac276f5726a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:07.523318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01128417-84f0-4e42-8972-bac276f5726a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:07.649684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-01128417-84f0-4e42-8972-bac276f5726a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:07.656718 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-01128417-84f0-4e42-8972-bac276f5726a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1318 microversion: 2.1 time: 0.146183 Nov 16 19:08:07.657268 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 359/737] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:07 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:08.673935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f3d7fa0a-03b4-473b-9e75-cd4ac9d514fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:08.674539 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f3d7fa0a-03b4-473b-9e75-cd4ac9d514fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:08.680788 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3d7fa0a-03b4-473b-9e75-cd4ac9d514fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:08.681239 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3d7fa0a-03b4-473b-9e75-cd4ac9d514fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:08.682060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3d7fa0a-03b4-473b-9e75-cd4ac9d514fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:08.682530 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3d7fa0a-03b4-473b-9e75-cd4ac9d514fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:08.811055 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f3d7fa0a-03b4-473b-9e75-cd4ac9d514fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:08.818766 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f3d7fa0a-03b4-473b-9e75-cd4ac9d514fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1318 microversion: 2.1 time: 0.147973 Nov 16 19:08:08.819321 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 379/738] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:08 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:09.835481 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c466340e-4051-4803-8994-d31c2a4d6a6c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:09.836221 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c466340e-4051-4803-8994-d31c2a4d6a6c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:09.842472 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c466340e-4051-4803-8994-d31c2a4d6a6c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:09.842917 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c466340e-4051-4803-8994-d31c2a4d6a6c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:09.843694 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c466340e-4051-4803-8994-d31c2a4d6a6c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:09.844123 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c466340e-4051-4803-8994-d31c2a4d6a6c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:09.934279 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-1fec71bf-072a-42a3-9886-f72d92b6170c req-a0c533f2-ee01-459d-a526-e9cc208fa8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e52ea22-a91d-49af-bb25-1b1d20df5768", "name": "network-vif-plugged", "status": "completed", "tag": "8e5b3f73-ec0e-4a71-9000-d46d548d6adf"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:09.936003 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:08:09.936003 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:08:09.943351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-1fec71bf-072a-42a3-9886-f72d92b6170c req-a0c533f2-ee01-459d-a526-e9cc208fa8fb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:09.943855 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-1fec71bf-072a-42a3-9886-f72d92b6170c req-a0c533f2-ee01-459d-a526-e9cc208fa8fb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:09.954922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-1fec71bf-072a-42a3-9886-f72d92b6170c req-a0c533f2-ee01-459d-a526-e9cc208fa8fb service nova] Creating event network-vif-plugged:8e5b3f73-ec0e-4a71-9000-d46d548d6adf for instance 0e52ea22-a91d-49af-bb25-1b1d20df5768 on hv-cinder-66710 Nov 16 19:08:09.960077 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-1fec71bf-072a-42a3-9886-f72d92b6170c req-a0c533f2-ee01-459d-a526-e9cc208fa8fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029221 Nov 16 19:08:09.960791 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 380/739] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:08:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:09.985993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c466340e-4051-4803-8994-d31c2a4d6a6c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:09.995759 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c466340e-4051-4803-8994-d31c2a4d6a6c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1318 microversion: 2.1 time: 0.164090 Nov 16 19:08:09.996558 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 360/740] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:09 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:11.013635 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5cf260b9-42a3-468f-93c1-3f029493c777 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:11.014335 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5cf260b9-42a3-468f-93c1-3f029493c777 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:11.020365 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5cf260b9-42a3-468f-93c1-3f029493c777 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:11.021318 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5cf260b9-42a3-468f-93c1-3f029493c777 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:11.022112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5cf260b9-42a3-468f-93c1-3f029493c777 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:11.022548 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5cf260b9-42a3-468f-93c1-3f029493c777 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:11.150468 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5cf260b9-42a3-468f-93c1-3f029493c777 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:11.157519 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5cf260b9-42a3-468f-93c1-3f029493c777 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1318 microversion: 2.1 time: 0.148357 Nov 16 19:08:11.158099 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 381/741] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:11 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:12.174785 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f7e18523-0865-4c78-8f61-324a90085df0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:12.175383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f7e18523-0865-4c78-8f61-324a90085df0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:12.182251 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7e18523-0865-4c78-8f61-324a90085df0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:12.182699 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7e18523-0865-4c78-8f61-324a90085df0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:12.183471 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7e18523-0865-4c78-8f61-324a90085df0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:12.183901 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7e18523-0865-4c78-8f61-324a90085df0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:12.312097 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f7e18523-0865-4c78-8f61-324a90085df0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:12.319276 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f7e18523-0865-4c78-8f61-324a90085df0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1508 microversion: 2.1 time: 0.148114 Nov 16 19:08:12.319839 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 361/742] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:12 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:13.647143 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-596c5ec2-aedc-4670-9c69-309681517cc8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3ca752a-fe85-4f0d-a6c7-ddf929708533"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:13.648187 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-596c5ec2-aedc-4670-9c69-309681517cc8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:13.654349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-596c5ec2-aedc-4670-9c69-309681517cc8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:13.654790 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-596c5ec2-aedc-4670-9c69-309681517cc8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:13.655560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-596c5ec2-aedc-4670-9c69-309681517cc8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:13.655989 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-596c5ec2-aedc-4670-9c69-309681517cc8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:13.879076 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-596c5ec2-aedc-4670-9c69-309681517cc8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.237120 Nov 16 19:08:13.879680 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 382/743] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:08:13 2021] POST /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768/os-volume_attachments => generated 194 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:20.312423 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-215190449", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "e621ec68-f159-4652-a7d6-6091f1908e3b"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:20.364746 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] validate_networks() for [('e621ec68-f159-4652-a7d6-6091f1908e3b', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:08:20.945147 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:08:20.945592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:08:20.946056 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:08:20.946455 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:08:20.946858 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:08:20.955475 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:20.955915 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:20.956710 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:20.957141 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:20.975441 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Getting quotas for project 94b91bcf959046d98ee0e24ab094216b. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:08:20.979375 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Getting quotas for user 846d3005576a460cba07a39ee8596699 and project 94b91bcf959046d98ee0e24ab094216b. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:08:20.992296 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:08:20.994790 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:08:21.039786 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0294db58-f3c4-46dc-a334-af5cedd09cad tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730934 Nov 16 19:08:21.040415 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 362/744] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:08:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:08:21.051153 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-64a72e7c-8bf4-48b4-9d7c-6e452805eb16 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:21.051878 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-64a72e7c-8bf4-48b4-9d7c-6e452805eb16 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:21.102799 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-64a72e7c-8bf4-48b4-9d7c-6e452805eb16 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:21.109314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-64a72e7c-8bf4-48b4-9d7c-6e452805eb16 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1217 microversion: 2.1 time: 0.062726 Nov 16 19:08:21.109908 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 383/745] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:21 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:22.126650 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8b5f74fc-4600-409e-8df3-5170fcadd1d7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:22.127364 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8b5f74fc-4600-409e-8df3-5170fcadd1d7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:22.134575 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8b5f74fc-4600-409e-8df3-5170fcadd1d7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:22.135014 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8b5f74fc-4600-409e-8df3-5170fcadd1d7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:22.135781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8b5f74fc-4600-409e-8df3-5170fcadd1d7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:22.136206 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8b5f74fc-4600-409e-8df3-5170fcadd1d7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:22.202415 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-8b5f74fc-4600-409e-8df3-5170fcadd1d7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:22.209692 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8b5f74fc-4600-409e-8df3-5170fcadd1d7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1275 microversion: 2.1 time: 0.087156 Nov 16 19:08:22.210248 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 363/746] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:22 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:23.199373 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-97fd869c-2247-4e01-b0f0-fa84521c57eb req-6055ba0d-8dd6-448f-b5a5-06d55e6deb21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526863d1-282a-4442-8260-50cbaec699eb", "tag": "399dbb90-f15a-45a3-bcd8-026172ae7de5"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:23.201139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:08:23.201139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:08:23.210097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-97fd869c-2247-4e01-b0f0-fa84521c57eb req-6055ba0d-8dd6-448f-b5a5-06d55e6deb21 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:23.210625 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-97fd869c-2247-4e01-b0f0-fa84521c57eb req-6055ba0d-8dd6-448f-b5a5-06d55e6deb21 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:23.223560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-97fd869c-2247-4e01-b0f0-fa84521c57eb req-6055ba0d-8dd6-448f-b5a5-06d55e6deb21 service nova] Creating event network-changed:399dbb90-f15a-45a3-bcd8-026172ae7de5 for instance 526863d1-282a-4442-8260-50cbaec699eb on hv-cinder-66710 Nov 16 19:08:23.228661 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7fd7ed34-6865-4cf5-aa7d-5884db632e9a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:23.229271 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7fd7ed34-6865-4cf5-aa7d-5884db632e9a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:23.229807 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-97fd869c-2247-4e01-b0f0-fa84521c57eb req-6055ba0d-8dd6-448f-b5a5-06d55e6deb21 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034460 Nov 16 19:08:23.230397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 384/747] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:08:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:23.236111 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7fd7ed34-6865-4cf5-aa7d-5884db632e9a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:23.236484 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7fd7ed34-6865-4cf5-aa7d-5884db632e9a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:23.237265 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7fd7ed34-6865-4cf5-aa7d-5884db632e9a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:23.237715 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7fd7ed34-6865-4cf5-aa7d-5884db632e9a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:23.449717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7fd7ed34-6865-4cf5-aa7d-5884db632e9a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:23.456985 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7fd7ed34-6865-4cf5-aa7d-5884db632e9a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1317 microversion: 2.1 time: 0.233487 Nov 16 19:08:23.457572 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 364/748] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:23 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:08:24.475360 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fe42e6b2-d8d8-4c45-b7e7-115c008ee846 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:24.476061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fe42e6b2-d8d8-4c45-b7e7-115c008ee846 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:24.482124 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe42e6b2-d8d8-4c45-b7e7-115c008ee846 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:24.482574 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe42e6b2-d8d8-4c45-b7e7-115c008ee846 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:24.483352 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe42e6b2-d8d8-4c45-b7e7-115c008ee846 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:24.483787 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe42e6b2-d8d8-4c45-b7e7-115c008ee846 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:24.616405 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fe42e6b2-d8d8-4c45-b7e7-115c008ee846 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:24.623568 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fe42e6b2-d8d8-4c45-b7e7-115c008ee846 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1317 microversion: 2.1 time: 0.153250 Nov 16 19:08:24.624129 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 385/749] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:24 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:25.640715 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bb1de4fa-6d3d-42c4-8d26-78cc1a9db5f8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:25.641339 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bb1de4fa-6d3d-42c4-8d26-78cc1a9db5f8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:25.647874 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bb1de4fa-6d3d-42c4-8d26-78cc1a9db5f8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:25.648396 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bb1de4fa-6d3d-42c4-8d26-78cc1a9db5f8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:25.649149 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bb1de4fa-6d3d-42c4-8d26-78cc1a9db5f8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:25.649592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bb1de4fa-6d3d-42c4-8d26-78cc1a9db5f8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:25.774462 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bb1de4fa-6d3d-42c4-8d26-78cc1a9db5f8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:25.781980 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bb1de4fa-6d3d-42c4-8d26-78cc1a9db5f8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1317 microversion: 2.1 time: 0.144952 Nov 16 19:08:25.782576 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 365/750] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:25 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:26.799263 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0df7bb7f-0bca-4aba-bdf3-79a0ab87f3a6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:26.799869 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0df7bb7f-0bca-4aba-bdf3-79a0ab87f3a6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:26.806111 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0df7bb7f-0bca-4aba-bdf3-79a0ab87f3a6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:26.806557 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0df7bb7f-0bca-4aba-bdf3-79a0ab87f3a6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:26.807329 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0df7bb7f-0bca-4aba-bdf3-79a0ab87f3a6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:26.807764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0df7bb7f-0bca-4aba-bdf3-79a0ab87f3a6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:26.933688 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0df7bb7f-0bca-4aba-bdf3-79a0ab87f3a6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:26.940740 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0df7bb7f-0bca-4aba-bdf3-79a0ab87f3a6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1317 microversion: 2.1 time: 0.145153 Nov 16 19:08:26.941307 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 386/751] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:26 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:27.957284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9f59cbc4-b010-43d4-9037-c895212f2f72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:27.957939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9f59cbc4-b010-43d4-9037-c895212f2f72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:27.959268 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-dd031d66-64ad-4aa3-aef1-28dee94d5f50 req-7c2642f0-90dc-4372-9fc6-ff67bf53603a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526863d1-282a-4442-8260-50cbaec699eb", "name": "network-vif-plugged", "status": "completed", "tag": "399dbb90-f15a-45a3-bcd8-026172ae7de5"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:27.961228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:08:27.961228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:08:27.963971 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f59cbc4-b010-43d4-9037-c895212f2f72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:27.964410 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f59cbc4-b010-43d4-9037-c895212f2f72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:27.965177 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f59cbc4-b010-43d4-9037-c895212f2f72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:27.965717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9f59cbc4-b010-43d4-9037-c895212f2f72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:27.968560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-dd031d66-64ad-4aa3-aef1-28dee94d5f50 req-7c2642f0-90dc-4372-9fc6-ff67bf53603a service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:27.969006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-dd031d66-64ad-4aa3-aef1-28dee94d5f50 req-7c2642f0-90dc-4372-9fc6-ff67bf53603a service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:27.981925 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-dd031d66-64ad-4aa3-aef1-28dee94d5f50 req-7c2642f0-90dc-4372-9fc6-ff67bf53603a service nova] Creating event network-vif-plugged:399dbb90-f15a-45a3-bcd8-026172ae7de5 for instance 526863d1-282a-4442-8260-50cbaec699eb on hv-cinder-66710 Nov 16 19:08:27.987014 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-dd031d66-64ad-4aa3-aef1-28dee94d5f50 req-7c2642f0-90dc-4372-9fc6-ff67bf53603a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031861 Nov 16 19:08:27.987798 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 387/752] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:08:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:08:28.063242 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-75a07d94-8b2f-404b-b1ae-185cce3e3196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:28.064426 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-75a07d94-8b2f-404b-b1ae-185cce3e3196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:28.071284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75a07d94-8b2f-404b-b1ae-185cce3e3196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:28.071745 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75a07d94-8b2f-404b-b1ae-185cce3e3196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:28.072541 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75a07d94-8b2f-404b-b1ae-185cce3e3196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:28.073130 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75a07d94-8b2f-404b-b1ae-185cce3e3196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:28.106786 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-75a07d94-8b2f-404b-b1ae-185cce3e3196 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047570 Nov 16 19:08:28.107366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 388/753] 10.222.0.46 () {60 vars in 1342 bytes} [Tue Nov 16 19:08:28 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:08:28.145497 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9f59cbc4-b010-43d4-9037-c895212f2f72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:28.157619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9f59cbc4-b010-43d4-9037-c895212f2f72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1317 microversion: 2.1 time: 0.199725 Nov 16 19:08:28.157619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 366/754] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:27 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:08:28.168298 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-91744b6f-6f45-4080-b954-33634753bc47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:28.168804 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-91744b6f-6f45-4080-b954-33634753bc47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:28.174795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91744b6f-6f45-4080-b954-33634753bc47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:28.175250 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91744b6f-6f45-4080-b954-33634753bc47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:28.176034 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91744b6f-6f45-4080-b954-33634753bc47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:28.176472 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91744b6f-6f45-4080-b954-33634753bc47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:28.200634 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-91744b6f-6f45-4080-b954-33634753bc47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:08:28.273115 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-91744b6f-6f45-4080-b954-33634753bc47 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "DELETE /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 204 len: 0 microversion: 2.20 time: 0.108406 Nov 16 19:08:28.273688 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 389/755] 10.222.0.46 () {60 vars in 1279 bytes} [Tue Nov 16 19:08:28 2021] DELETE /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 19:08:28.281638 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:28.282240 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:28.288720 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:28.289197 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:28.289992 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:28.290572 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:28.417356 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:28.425002 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:28.426533 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:28.427727 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ff57d9ca-238a-4354-bcbc-cf1c80696c32 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.149800 Nov 16 19:08:28.428299 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 367/756] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:08:28 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:08:29.170812 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5b968a42-fa30-4362-9757-e35f0e2c202b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:29.171529 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5b968a42-fa30-4362-9757-e35f0e2c202b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:29.177714 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5b968a42-fa30-4362-9757-e35f0e2c202b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:29.178162 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5b968a42-fa30-4362-9757-e35f0e2c202b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:29.178922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5b968a42-fa30-4362-9757-e35f0e2c202b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:29.179349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5b968a42-fa30-4362-9757-e35f0e2c202b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:29.309807 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5b968a42-fa30-4362-9757-e35f0e2c202b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:29.317035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5b968a42-fa30-4362-9757-e35f0e2c202b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1317 microversion: 2.1 time: 0.150252 Nov 16 19:08:29.317619 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 390/757] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:29 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:29.446072 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:29.446722 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:29.452898 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:29.453343 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:29.454147 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:29.454578 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:29.592080 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:29.600303 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:29.601827 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:29.602974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-77fdda00-21fa-4268-8926-2fa88e11899d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1720 microversion: 2.20 time: 0.160879 Nov 16 19:08:29.603534 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 368/758] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:08:29 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:08:30.335582 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-41679687-009e-42d1-a42a-3f7ad39ae05a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:30.336186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-41679687-009e-42d1-a42a-3f7ad39ae05a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:30.342384 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41679687-009e-42d1-a42a-3f7ad39ae05a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.342826 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41679687-009e-42d1-a42a-3f7ad39ae05a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.343811 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41679687-009e-42d1-a42a-3f7ad39ae05a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.344245 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41679687-009e-42d1-a42a-3f7ad39ae05a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.480711 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-41679687-009e-42d1-a42a-3f7ad39ae05a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:30.488017 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-41679687-009e-42d1-a42a-3f7ad39ae05a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1507 microversion: 2.1 time: 0.156834 Nov 16 19:08:30.488594 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 391/759] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:30 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:30.505200 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3ca752a-fe85-4f0d-a6c7-ddf929708533"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:30.506874 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:30.512771 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.513207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.514003 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.514428 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.590792 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] HTTP exception thrown: Invalid volume: volume a3ca752a-fe85-4f0d-a6c7-ddf929708533 is already attached to instances: 0e52ea22-a91d-49af-bb25-1b1d20df5768 Nov 16 19:08:30.591384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Returning 400 to user: Invalid volume: volume a3ca752a-fe85-4f0d-a6c7-ddf929708533 is already attached to instances: 0e52ea22-a91d-49af-bb25-1b1d20df5768 {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:08:30.592235 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8e30a262-092a-40bc-ad84-0966718bcae3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091407 Nov 16 19:08:30.592783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 369/760] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:08:30 2021] POST /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 19:08:30.620741 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:30.621348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:30.627593 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.628045 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.628853 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.629732 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.655707 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c7d8c81f-81e8-44bc-be03-908d76ca0a7c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:30.656565 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c7d8c81f-81e8-44bc-be03-908d76ca0a7c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:30.664387 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7d8c81f-81e8-44bc-be03-908d76ca0a7c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.665072 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7d8c81f-81e8-44bc-be03-908d76ca0a7c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.666071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7d8c81f-81e8-44bc-be03-908d76ca0a7c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.666645 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7d8c81f-81e8-44bc-be03-908d76ca0a7c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.728097 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:30.742878 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:30.744416 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc21495c8b60405194f1a6ea2de3e9e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b9aa6405c640ff81bc02db314b5e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:30.745600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-58b14723-7305-435c-bc43-fe93bd7e52d4 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 200 len: 1654 microversion: 2.20 time: 0.128755 Nov 16 19:08:30.746502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 392/761] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:08:30 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 1654 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 19:08:30.770326 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-c7d8c81f-81e8-44bc-be03-908d76ca0a7c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lazy-loading 'services' on Instance uuid 0e52ea22-a91d-49af-bb25-1b1d20df5768 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:08:30.841951 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c7d8c81f-81e8-44bc-be03-908d76ca0a7c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768/os-volume_attachments/a3ca752a-fe85-4f0d-a6c7-ddf929708533" status: 202 len: 0 microversion: 2.1 time: 0.190094 Nov 16 19:08:30.842532 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 370/762] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:08:30 2021] DELETE /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768/os-volume_attachments/a3ca752a-fe85-4f0d-a6c7-ddf929708533 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:08:30.851907 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bc021f8a-c0ca-443f-aed1-67b799092d3f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:30.852831 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bc021f8a-c0ca-443f-aed1-67b799092d3f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:30.859334 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc021f8a-c0ca-443f-aed1-67b799092d3f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.859947 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc021f8a-c0ca-443f-aed1-67b799092d3f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.860652 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc021f8a-c0ca-443f-aed1-67b799092d3f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:30.861110 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc021f8a-c0ca-443f-aed1-67b799092d3f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:30.894012 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bc021f8a-c0ca-443f-aed1-67b799092d3f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Nov 16 19:08:30.894968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 393/763] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:08:30 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:30.989141 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-58f53f54-04e6-4807-8117-bbf9e8fabdfa req-09c90fa7-3523-4425-801e-039d1b0569cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4", "name": "network-vif-deleted", "tag": "5a94a757-e4b7-461b-a346-267538387bdf"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:30.991698 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:08:30.991698 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:08:30.999790 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-58f53f54-04e6-4807-8117-bbf9e8fabdfa req-09c90fa7-3523-4425-801e-039d1b0569cc service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:31.000225 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-58f53f54-04e6-4807-8117-bbf9e8fabdfa req-09c90fa7-3523-4425-801e-039d1b0569cc service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:31.014187 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-58f53f54-04e6-4807-8117-bbf9e8fabdfa req-09c90fa7-3523-4425-801e-039d1b0569cc service nova] Creating event network-vif-deleted:5a94a757-e4b7-461b-a346-267538387bdf for instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 on hv-cinder-66710 Nov 16 19:08:31.019340 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-58f53f54-04e6-4807-8117-bbf9e8fabdfa req-09c90fa7-3523-4425-801e-039d1b0569cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036842 Nov 16 19:08:31.020259 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 371/764] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:08:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:31.763928 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:31.764527 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:31.771502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:31.771947 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:31.772724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:31.773149 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:31.787565 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] HTTP exception thrown: Instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 could not be found. Nov 16 19:08:31.788160 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Returning 404 to user: Instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:08:31.788990 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c0febbe4-9197-4403-a934-06d558dd7a63 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 404 len: 111 microversion: 2.20 time: 0.028752 Nov 16 19:08:31.789534 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 394/765] 10.222.0.46 () {60 vars in 1276 bytes} [Tue Nov 16 19:08:31 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 16 19:08:31.799033 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1ddcd434-33c3-4841-8da9-bc073f68746c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '.version_select at 0x7ffa56c5af70>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:31.817336 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1ddcd434-33c3-4841-8da9-bc073f68746c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037811477" status: 204 len: 0 microversion: 2.20 time: 0.022877 Nov 16 19:08:31.818771 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 372/766] 10.222.0.46 () {60 vars in 1261 bytes} [Tue Nov 16 19:08:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037811477 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 19:08:31.906345 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7584a5da-6cd2-4665-bed8-12db12e9e717 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:31.908162 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7584a5da-6cd2-4665-bed8-12db12e9e717 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:31.914411 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7584a5da-6cd2-4665-bed8-12db12e9e717 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:31.914868 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7584a5da-6cd2-4665-bed8-12db12e9e717 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:31.915657 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7584a5da-6cd2-4665-bed8-12db12e9e717 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:31.916099 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7584a5da-6cd2-4665-bed8-12db12e9e717 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:31.946725 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7584a5da-6cd2-4665-bed8-12db12e9e717 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044546 Nov 16 19:08:31.947290 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 395/767] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:08:31 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:08:32.060956 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1554998085", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "e621ec68-f159-4652-a7d6-6091f1908e3b"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:32.111204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] validate_networks() for [('e621ec68-f159-4652-a7d6-6091f1908e3b', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:08:32.489264 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:08:32.490364 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:08:32.490854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:08:32.491254 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:08:32.491652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:08:32.500458 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:32.500980 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:32.502011 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:32.502871 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:32.521408 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Getting quotas for project 94b91bcf959046d98ee0e24ab094216b. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:08:32.526209 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Getting quotas for user 846d3005576a460cba07a39ee8596699 and project 94b91bcf959046d98ee0e24ab094216b. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:08:32.539388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:08:32.541906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:08:32.587494 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ce3ea9da-88f4-42b6-b48f-7e1f1d68c02f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530130 Nov 16 19:08:32.588131 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 373/768] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:08:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:08:32.597607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7a11310d-ec57-4221-8e42-05d180a3b8cb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:32.598214 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7a11310d-ec57-4221-8e42-05d180a3b8cb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:32.648973 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7a11310d-ec57-4221-8e42-05d180a3b8cb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:32.656305 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7a11310d-ec57-4221-8e42-05d180a3b8cb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1218 microversion: 2.1 time: 0.061746 Nov 16 19:08:32.656878 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 396/769] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:32 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:33.610990 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:33.611534 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:33.619122 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:33.619567 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:33.620346 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:33.620774 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:33.634733 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] HTTP exception thrown: Instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 could not be found. Nov 16 19:08:33.635499 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Returning 404 to user: Instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:08:33.636329 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c58c3046-9378-4fca-8b95-f825cdd1e26c tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "DELETE /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 404 len: 111 microversion: 2.1 time: 0.029071 Nov 16 19:08:33.636863 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 374/770] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:08:33 2021] DELETE /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:08:33.644595 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:33.645204 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:33.651481 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:33.651926 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:33.652690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:33.653119 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:33.666004 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] HTTP exception thrown: Instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 could not be found. Nov 16 19:08:33.666590 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Returning 404 to user: Instance 072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:08:33.667409 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-89959c8c-eae8-4cb6-9d6b-fc0c3b6a9314 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4" status: 404 len: 111 microversion: 2.1 time: 0.026588 Nov 16 19:08:33.667958 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 397/771] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:33 2021] GET /compute/v2.1/servers/072ed4c5-163c-4cca-8d6e-5fe8b9ecb9a4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 19:08:33.674459 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d2309dfe-029e-494e-a712-37d0292a17f0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:33.675059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d2309dfe-029e-494e-a712-37d0292a17f0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:33.681390 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d2309dfe-029e-494e-a712-37d0292a17f0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:33.681859 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d2309dfe-029e-494e-a712-37d0292a17f0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:33.682631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d2309dfe-029e-494e-a712-37d0292a17f0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:33.683055 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d2309dfe-029e-494e-a712-37d0292a17f0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:33.747264 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d2309dfe-029e-494e-a712-37d0292a17f0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:33.756769 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d2309dfe-029e-494e-a712-37d0292a17f0 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1276 microversion: 2.1 time: 0.085996 Nov 16 19:08:33.757374 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 375/772] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:33 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:34.774802 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3412deb2-f498-475d-a493-fabcd2e617eb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:34.775335 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3412deb2-f498-475d-a493-fabcd2e617eb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:34.782164 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3412deb2-f498-475d-a493-fabcd2e617eb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:34.782886 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3412deb2-f498-475d-a493-fabcd2e617eb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:34.783403 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3412deb2-f498-475d-a493-fabcd2e617eb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:34.784011 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3412deb2-f498-475d-a493-fabcd2e617eb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:34.805510 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:34.806078 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:34.812503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:34.812954 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:34.814260 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:34.814712 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:34.829863 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] HTTP exception thrown: Instance b188c4dd-b4cc-4a02-9ea4-901009c68534 could not be found. Nov 16 19:08:34.830470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Returning 404 to user: Instance b188c4dd-b4cc-4a02-9ea4-901009c68534 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:08:34.831303 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-59000ca8-c779-4b67-9399-0022dac8b577 tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 404 len: 111 microversion: 2.1 time: 0.030334 Nov 16 19:08:34.834045 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 376/773] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:08:34 2021] DELETE /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:08:34.840844 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:34.841733 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] [instance: b188c4dd-b4cc-4a02-9ea4-901009c68534] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:34.848911 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:34.849676 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:34.850636 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:34.851222 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:34.867715 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] HTTP exception thrown: Instance b188c4dd-b4cc-4a02-9ea4-901009c68534 could not be found. Nov 16 19:08:34.868604 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] Returning 404 to user: Instance b188c4dd-b4cc-4a02-9ea4-901009c68534 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:08:34.869652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8688c54a-0b1a-4c98-b2c3-c6d6765d154d tempest-AttachVolumeShelveTestJSON-749453684 tempest-AttachVolumeShelveTestJSON-749453684-project] 10.222.0.46 "GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534" status: 404 len: 111 microversion: 2.1 time: 0.032508 Nov 16 19:08:34.870728 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 377/774] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:34 2021] GET /compute/v2.1/servers/b188c4dd-b4cc-4a02-9ea4-901009c68534 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:08:34.926522 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3412deb2-f498-475d-a493-fabcd2e617eb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:34.935076 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3412deb2-f498-475d-a493-fabcd2e617eb tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1318 microversion: 2.1 time: 0.164556 Nov 16 19:08:34.935662 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 398/775] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:34 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:35.250552 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-9d9c0b67-10ab-4e93-af1f-04044088b65b req-51ff5089-c1da-4828-9dd6-8d087ccc6c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aab4024-3d77-4531-a0d5-4fd77dd7e7bb", "tag": "ffe6f08b-8236-468c-9d55-7fe6ddacd142"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:35.252609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:08:35.252609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:08:35.260969 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-9d9c0b67-10ab-4e93-af1f-04044088b65b req-51ff5089-c1da-4828-9dd6-8d087ccc6c6a service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:35.261404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-9d9c0b67-10ab-4e93-af1f-04044088b65b req-51ff5089-c1da-4828-9dd6-8d087ccc6c6a service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:35.273776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-9d9c0b67-10ab-4e93-af1f-04044088b65b req-51ff5089-c1da-4828-9dd6-8d087ccc6c6a service nova] Creating event network-changed:ffe6f08b-8236-468c-9d55-7fe6ddacd142 for instance 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb on hv-cinder-66710 Nov 16 19:08:35.278637 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-9d9c0b67-10ab-4e93-af1f-04044088b65b req-51ff5089-c1da-4828-9dd6-8d087ccc6c6a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032064 Nov 16 19:08:35.279154 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 378/776] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:08:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:35.952956 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a0024715-39c2-4a55-bbce-9614a7fa5117 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:35.953756 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a0024715-39c2-4a55-bbce-9614a7fa5117 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:35.960219 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0024715-39c2-4a55-bbce-9614a7fa5117 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:35.960775 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0024715-39c2-4a55-bbce-9614a7fa5117 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:35.961671 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0024715-39c2-4a55-bbce-9614a7fa5117 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:35.962355 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0024715-39c2-4a55-bbce-9614a7fa5117 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:36.167737 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a0024715-39c2-4a55-bbce-9614a7fa5117 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:36.175648 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a0024715-39c2-4a55-bbce-9614a7fa5117 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1318 microversion: 2.1 time: 0.226513 Nov 16 19:08:36.176213 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 399/777] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:35 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:37.198164 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-88f17c78-b6b3-4fcc-b829-a87f4fbb408c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:37.200237 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-88f17c78-b6b3-4fcc-b829-a87f4fbb408c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:37.211461 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-88f17c78-b6b3-4fcc-b829-a87f4fbb408c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:37.211913 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-88f17c78-b6b3-4fcc-b829-a87f4fbb408c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:37.215018 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-88f17c78-b6b3-4fcc-b829-a87f4fbb408c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:37.222789 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-88f17c78-b6b3-4fcc-b829-a87f4fbb408c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:37.396875 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-88f17c78-b6b3-4fcc-b829-a87f4fbb408c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:37.404085 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-88f17c78-b6b3-4fcc-b829-a87f4fbb408c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1318 microversion: 2.1 time: 0.214311 Nov 16 19:08:37.404651 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 379/778] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:37 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:38.422801 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-66cebf68-92f1-4698-b9fc-2bc5443ec574 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:38.423632 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-66cebf68-92f1-4698-b9fc-2bc5443ec574 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:38.431131 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-66cebf68-92f1-4698-b9fc-2bc5443ec574 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:38.431581 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-66cebf68-92f1-4698-b9fc-2bc5443ec574 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:38.432373 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-66cebf68-92f1-4698-b9fc-2bc5443ec574 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:38.432809 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-66cebf68-92f1-4698-b9fc-2bc5443ec574 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:38.665088 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-66cebf68-92f1-4698-b9fc-2bc5443ec574 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:38.672751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-66cebf68-92f1-4698-b9fc-2bc5443ec574 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1318 microversion: 2.1 time: 0.254588 Nov 16 19:08:38.673626 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 400/779] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:38 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:39.638693 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0df454c9-9b2a-4c24-b832-6784166e1ff1 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] Action: 'create', calling method: .version_select at 0x7ffa56c4eaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1403721225", "metadata": {"Type": "work"}}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:39.690174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8c62adfe-c26b-4c72-8fdb-aa0679a448fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:39.690780 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8c62adfe-c26b-4c72-8fdb-aa0679a448fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:39.697390 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c62adfe-c26b-4c72-8fdb-aa0679a448fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:39.697892 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c62adfe-c26b-4c72-8fdb-aa0679a448fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:39.698657 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c62adfe-c26b-4c72-8fdb-aa0679a448fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:39.699083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8c62adfe-c26b-4c72-8fdb-aa0679a448fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:39.835947 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8c62adfe-c26b-4c72-8fdb-aa0679a448fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:39.846043 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8c62adfe-c26b-4c72-8fdb-aa0679a448fa tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1318 microversion: 2.1 time: 0.159101 Nov 16 19:08:39.856571 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 401/780] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:39 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:08:39.930544 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0df454c9-9b2a-4c24-b832-6784166e1ff1 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.398705 Nov 16 19:08:39.931158 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 380/781] 10.222.0.46 () {60 vars in 1155 bytes} [Tue Nov 16 19:08:39 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 400 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 16 19:08:39.942966 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1cb9dea5-667a-494a-ae90-35b58fdd3391 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] Calling method '.version_select at 0x7ffa56cb0af0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:39.998611 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1cb9dea5-667a-494a-ae90-35b58fdd3391 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6" status: 200 len: 353 microversion: 2.1 time: 0.059827 Nov 16 19:08:39.999173 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 402/782] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:08:39 2021] GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:40.864783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c03568a2-9c6a-48b0-b72d-f3e4ff5e27ee tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:40.865420 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c03568a2-9c6a-48b0-b72d-f3e4ff5e27ee tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:40.872115 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c03568a2-9c6a-48b0-b72d-f3e4ff5e27ee tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:40.872558 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c03568a2-9c6a-48b0-b72d-f3e4ff5e27ee tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:40.873324 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c03568a2-9c6a-48b0-b72d-f3e4ff5e27ee tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:40.873778 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c03568a2-9c6a-48b0-b72d-f3e4ff5e27ee tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:41.000952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c03568a2-9c6a-48b0-b72d-f3e4ff5e27ee tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:41.008642 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c03568a2-9c6a-48b0-b72d-f3e4ff5e27ee tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1318 microversion: 2.1 time: 0.148145 Nov 16 19:08:41.009219 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 381/783] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:40 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:41.011382 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b409f3e6-7927-442e-aa11-4f9c0ab85e27 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] Calling method '.version_select at 0x7ffa56bf54c0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:41.055290 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b409f3e6-7927-442e-aa11-4f9c0ab85e27 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6" status: 200 len: 354 microversion: 2.1 time: 0.047822 Nov 16 19:08:41.055835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 403/784] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:08:41 2021] GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6 => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:08:41.066353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2652876f-9171-402f-aea3-f046c787ca72 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] Calling method '.version_select at 0x7ffa56bc4280>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:41.110590 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2652876f-9171-402f-aea3-f046c787ca72 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6" status: 200 len: 354 microversion: 2.1 time: 0.047768 Nov 16 19:08:41.111134 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 382/785] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:08:41 2021] GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6 => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:41.126706 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cfd8e7c3-52df-466e-85ba-bbce98854711 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] Calling method '.version_select at 0x7ffa56bf5d30>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:41.184800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cfd8e7c3-52df-466e-85ba-bbce98854711 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6" status: 202 len: 0 microversion: 2.1 time: 0.061697 Nov 16 19:08:41.185883 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 404/786] 10.222.0.46 () {58 vars in 1247 bytes} [Tue Nov 16 19:08:41 2021] DELETE /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:08:41.193772 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3cda12e9-8bb0-4159-9b1d-737ebebb7fea tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] Calling method '.version_select at 0x7ffa56c421f0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:41.241827 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3cda12e9-8bb0-4159-9b1d-737ebebb7fea tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6" status: 200 len: 353 microversion: 2.1 time: 0.052108 Nov 16 19:08:41.242384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 383/787] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:08:41 2021] GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:42.009380 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-7824a409-c59d-4b17-89cd-d3390f4c47e7 req-601021dd-09f4-4ed7-b12d-0e4d837a6745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aab4024-3d77-4531-a0d5-4fd77dd7e7bb", "name": "network-vif-plugged", "status": "completed", "tag": "ffe6f08b-8236-468c-9d55-7fe6ddacd142"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:42.010965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:08:42.010965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:08:42.018677 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-7824a409-c59d-4b17-89cd-d3390f4c47e7 req-601021dd-09f4-4ed7-b12d-0e4d837a6745 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:42.021363 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-7824a409-c59d-4b17-89cd-d3390f4c47e7 req-601021dd-09f4-4ed7-b12d-0e4d837a6745 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:42.026974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e154ea69-b368-4d73-ba38-423a83500926 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:42.028639 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e154ea69-b368-4d73-ba38-423a83500926 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:42.031732 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-7824a409-c59d-4b17-89cd-d3390f4c47e7 req-601021dd-09f4-4ed7-b12d-0e4d837a6745 service nova] Creating event network-vif-plugged:ffe6f08b-8236-468c-9d55-7fe6ddacd142 for instance 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb on hv-cinder-66710 Nov 16 19:08:42.036360 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e154ea69-b368-4d73-ba38-423a83500926 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:42.036689 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-7824a409-c59d-4b17-89cd-d3390f4c47e7 req-601021dd-09f4-4ed7-b12d-0e4d837a6745 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030954 Nov 16 19:08:42.037296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 405/788] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:08:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:42.037706 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e154ea69-b368-4d73-ba38-423a83500926 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:42.038726 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e154ea69-b368-4d73-ba38-423a83500926 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:42.039193 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e154ea69-b368-4d73-ba38-423a83500926 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:42.198836 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e154ea69-b368-4d73-ba38-423a83500926 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:42.208359 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e154ea69-b368-4d73-ba38-423a83500926 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1318 microversion: 2.1 time: 0.185430 Nov 16 19:08:42.209219 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 384/789] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:42 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:08:42.255666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2e527eb1-6b84-4adf-91e3-f56d41fcbe34 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] Calling method '.version_select at 0x7ffa56bbff70>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:42.282548 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-2e527eb1-6b84-4adf-91e3-f56d41fcbe34 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] HTTP exception thrown: Volume dc1a6e33-483f-4b37-b928-669b383a6af6 could not be found. Nov 16 19:08:42.283144 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2e527eb1-6b84-4adf-91e3-f56d41fcbe34 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] Returning 404 to user: Volume dc1a6e33-483f-4b37-b928-669b383a6af6 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:08:42.283975 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2e527eb1-6b84-4adf-91e3-f56d41fcbe34 tempest-VolumesGetTestJSON-567359249 tempest-VolumesGetTestJSON-567359249-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6" status: 404 len: 109 microversion: 2.1 time: 0.033179 Nov 16 19:08:42.284538 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 406/790] 10.222.0.46 () {58 vars in 1244 bytes} [Tue Nov 16 19:08:42 2021] GET /compute/v2.1/os-volumes/dc1a6e33-483f-4b37-b928-669b383a6af6 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:08:43.226696 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8e27dad3-566e-4f32-b512-b1e7d5a7587a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:43.227249 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8e27dad3-566e-4f32-b512-b1e7d5a7587a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:43.233366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8e27dad3-566e-4f32-b512-b1e7d5a7587a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:43.233852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8e27dad3-566e-4f32-b512-b1e7d5a7587a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:43.234628 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8e27dad3-566e-4f32-b512-b1e7d5a7587a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:43.235103 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8e27dad3-566e-4f32-b512-b1e7d5a7587a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:43.372446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-8e27dad3-566e-4f32-b512-b1e7d5a7587a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:43.381057 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8e27dad3-566e-4f32-b512-b1e7d5a7587a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1318 microversion: 2.1 time: 0.158633 Nov 16 19:08:43.381880 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 385/791] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:43 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:08:44.398659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1306a9d3-e339-4c17-ab8b-8a8a03884513 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:44.399600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1306a9d3-e339-4c17-ab8b-8a8a03884513 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:44.406751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1306a9d3-e339-4c17-ab8b-8a8a03884513 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:44.407316 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1306a9d3-e339-4c17-ab8b-8a8a03884513 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:44.408124 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1306a9d3-e339-4c17-ab8b-8a8a03884513 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:44.408525 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1306a9d3-e339-4c17-ab8b-8a8a03884513 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:44.538936 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1306a9d3-e339-4c17-ab8b-8a8a03884513 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:08:44.546171 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1306a9d3-e339-4c17-ab8b-8a8a03884513 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1509 microversion: 2.1 time: 0.151688 Nov 16 19:08:44.546730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 407/792] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:08:44 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:08:45.851327 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-3a4068c9-a07b-4963-83df-41f5508f3a11 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14e73ee8-a46b-4dc0-8c99-30df8ad7ec2f"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:45.852452 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-3a4068c9-a07b-4963-83df-41f5508f3a11 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:45.858685 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3a4068c9-a07b-4963-83df-41f5508f3a11 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:45.859120 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3a4068c9-a07b-4963-83df-41f5508f3a11 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:45.859880 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3a4068c9-a07b-4963-83df-41f5508f3a11 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:45.860301 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-3a4068c9-a07b-4963-83df-41f5508f3a11 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:48.782066 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-3a4068c9-a07b-4963-83df-41f5508f3a11 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.934394 Nov 16 19:08:48.782747 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 386/793] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:08:45 2021] POST /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments => generated 194 bytes in 2936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:56.233797 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14e73ee8-a46b-4dc0-8c99-30df8ad7ec2f"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:08:56.234846 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:56.241236 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:56.241735 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:56.242543 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:56.242976 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:56.316165 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] HTTP exception thrown: Invalid volume: volume 14e73ee8-a46b-4dc0-8c99-30df8ad7ec2f is already attached to instances: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb Nov 16 19:08:56.316758 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Returning 400 to user: Invalid volume: volume 14e73ee8-a46b-4dc0-8c99-30df8ad7ec2f is already attached to instances: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:08:56.317594 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-17842f7e-9dee-4e00-855a-38e702d8492f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.087676 Nov 16 19:08:56.318174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 408/794] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:08:56 2021] POST /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments => generated 174 bytes in 89 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 19:08:56.374759 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-89a175d9-b345-4a57-ba91-f06e3d531e72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:56.375331 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-89a175d9-b345-4a57-ba91-f06e3d531e72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:56.381968 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89a175d9-b345-4a57-ba91-f06e3d531e72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:56.382410 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89a175d9-b345-4a57-ba91-f06e3d531e72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:56.383697 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89a175d9-b345-4a57-ba91-f06e3d531e72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:56.384123 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-89a175d9-b345-4a57-ba91-f06e3d531e72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:56.459804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-89a175d9-b345-4a57-ba91-f06e3d531e72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lazy-loading 'services' on Instance uuid 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:08:56.534457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-89a175d9-b345-4a57-ba91-f06e3d531e72 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments/14e73ee8-a46b-4dc0-8c99-30df8ad7ec2f" status: 202 len: 0 microversion: 2.1 time: 0.161576 Nov 16 19:08:56.534457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 387/795] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:08:56 2021] DELETE /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments/14e73ee8-a46b-4dc0-8c99-30df8ad7ec2f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:08:56.540846 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0d0b8db5-45f0-44b4-9f37-7ca4a688ad3d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:56.541786 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0d0b8db5-45f0-44b4-9f37-7ca4a688ad3d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:56.548354 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d0b8db5-45f0-44b4-9f37-7ca4a688ad3d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:56.548794 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d0b8db5-45f0-44b4-9f37-7ca4a688ad3d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:56.549719 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d0b8db5-45f0-44b4-9f37-7ca4a688ad3d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:56.550152 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d0b8db5-45f0-44b4-9f37-7ca4a688ad3d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:56.579038 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0d0b8db5-45f0-44b4-9f37-7ca4a688ad3d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Nov 16 19:08:56.579584 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 409/796] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:08:56 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:57.591253 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-92a0baca-729b-4889-b7ad-45ff56b18482 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:57.592284 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-92a0baca-729b-4889-b7ad-45ff56b18482 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:57.598218 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-92a0baca-729b-4889-b7ad-45ff56b18482 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:57.598652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-92a0baca-729b-4889-b7ad-45ff56b18482 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:57.599404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-92a0baca-729b-4889-b7ad-45ff56b18482 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:57.599826 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-92a0baca-729b-4889-b7ad-45ff56b18482 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:57.628641 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-92a0baca-729b-4889-b7ad-45ff56b18482 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041930 Nov 16 19:08:57.629180 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 388/797] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:08:57 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:58.639882 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-964f6d49-76de-40d1-90e4-3583521a532f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:58.640782 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-964f6d49-76de-40d1-90e4-3583521a532f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:58.646555 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-964f6d49-76de-40d1-90e4-3583521a532f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:58.646999 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-964f6d49-76de-40d1-90e4-3583521a532f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:58.647753 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-964f6d49-76de-40d1-90e4-3583521a532f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:58.648186 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-964f6d49-76de-40d1-90e4-3583521a532f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:58.675810 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-964f6d49-76de-40d1-90e4-3583521a532f tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039892 Nov 16 19:08:58.676348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 410/798] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:08:58 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:08:59.688189 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-51f4080d-b11d-4428-8382-6ca4faa11bb3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:08:59.689190 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-51f4080d-b11d-4428-8382-6ca4faa11bb3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:08:59.695530 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-51f4080d-b11d-4428-8382-6ca4faa11bb3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:59.696044 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-51f4080d-b11d-4428-8382-6ca4faa11bb3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:59.697458 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-51f4080d-b11d-4428-8382-6ca4faa11bb3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:08:59.697973 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-51f4080d-b11d-4428-8382-6ca4faa11bb3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:08:59.726953 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-51f4080d-b11d-4428-8382-6ca4faa11bb3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Nov 16 19:08:59.727497 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 389/799] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:08:59 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:00.738558 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-88c6860f-22c3-4de6-8514-1aaeaf4fd022 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:00.739464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-88c6860f-22c3-4de6-8514-1aaeaf4fd022 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:00.746373 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-88c6860f-22c3-4de6-8514-1aaeaf4fd022 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:00.746829 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-88c6860f-22c3-4de6-8514-1aaeaf4fd022 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:00.747585 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-88c6860f-22c3-4de6-8514-1aaeaf4fd022 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:00.748012 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-88c6860f-22c3-4de6-8514-1aaeaf4fd022 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:00.776185 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-88c6860f-22c3-4de6-8514-1aaeaf4fd022 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041314 Nov 16 19:09:00.776907 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 411/800] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:09:00 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:09:00.923249 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1831937711", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "e621ec68-f159-4652-a7d6-6091f1908e3b"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:00.982747 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] validate_networks() for [('e621ec68-f159-4652-a7d6-6091f1908e3b', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:09:01.340558 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:09:01.341047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:09:01.341759 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:09:01.342164 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:09:01.342569 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:09:01.351040 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:01.351480 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:01.352285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:01.352712 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:01.368947 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Getting quotas for project 94b91bcf959046d98ee0e24ab094216b. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:09:01.373446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Getting quotas for user 846d3005576a460cba07a39ee8596699 and project 94b91bcf959046d98ee0e24ab094216b. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:09:01.384113 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:09:01.386437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:09:01.435831 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fe3a430b-0391-428b-b1e6-64b1bb9ba3dc tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516530 Nov 16 19:09:01.436533 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 390/801] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:09:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:09:01.450014 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2c5ca74d-c37f-4c10-a2a4-0ca6cd6fa31a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:01.450727 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2c5ca74d-c37f-4c10-a2a4-0ca6cd6fa31a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:01.502074 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2c5ca74d-c37f-4c10-a2a4-0ca6cd6fa31a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:01.508487 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2c5ca74d-c37f-4c10-a2a4-0ca6cd6fa31a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1218 microversion: 2.1 time: 0.062319 Nov 16 19:09:01.509044 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 412/802] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:01 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:09:02.525706 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-83c67877-e11a-4f79-97d6-831a66140cf6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:02.526310 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-83c67877-e11a-4f79-97d6-831a66140cf6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:02.532773 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-83c67877-e11a-4f79-97d6-831a66140cf6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:02.533212 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-83c67877-e11a-4f79-97d6-831a66140cf6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:02.533996 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-83c67877-e11a-4f79-97d6-831a66140cf6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:02.534427 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-83c67877-e11a-4f79-97d6-831a66140cf6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:02.592325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-83c67877-e11a-4f79-97d6-831a66140cf6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:02.599413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-83c67877-e11a-4f79-97d6-831a66140cf6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1222 microversion: 2.1 time: 0.077888 Nov 16 19:09:02.599974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 391/803] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:02 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:03.616697 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f01e9706-4176-47f3-8347-adb74982adf3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:03.617300 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f01e9706-4176-47f3-8347-adb74982adf3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:03.624306 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f01e9706-4176-47f3-8347-adb74982adf3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:03.624694 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f01e9706-4176-47f3-8347-adb74982adf3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:03.625459 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f01e9706-4176-47f3-8347-adb74982adf3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:03.625920 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f01e9706-4176-47f3-8347-adb74982adf3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:03.686874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f01e9706-4176-47f3-8347-adb74982adf3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:03.694092 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f01e9706-4176-47f3-8347-adb74982adf3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1214 microversion: 2.1 time: 0.081046 Nov 16 19:09:03.694654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 413/804] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:03 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:04.709861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-25b5d607-0075-41e6-8d8b-e81892127378 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:04.710479 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-25b5d607-0075-41e6-8d8b-e81892127378 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:04.717845 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-25b5d607-0075-41e6-8d8b-e81892127378 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:04.718362 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-25b5d607-0075-41e6-8d8b-e81892127378 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:04.719208 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-25b5d607-0075-41e6-8d8b-e81892127378 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:04.719750 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-25b5d607-0075-41e6-8d8b-e81892127378 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:04.786063 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-25b5d607-0075-41e6-8d8b-e81892127378 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:04.793766 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-25b5d607-0075-41e6-8d8b-e81892127378 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1276 microversion: 2.1 time: 0.087519 Nov 16 19:09:04.794332 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 392/805] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:04 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:05.811579 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-43e75a97-2928-45ed-ba04-59a2d58a8b98 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:05.812190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-43e75a97-2928-45ed-ba04-59a2d58a8b98 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:05.818456 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-43e75a97-2928-45ed-ba04-59a2d58a8b98 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:05.818908 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-43e75a97-2928-45ed-ba04-59a2d58a8b98 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:05.820128 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-43e75a97-2928-45ed-ba04-59a2d58a8b98 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:05.820556 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-43e75a97-2928-45ed-ba04-59a2d58a8b98 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:05.826188 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-0473bce6-9092-4d0d-87e2-78e1b49d20e0 req-b484513a-2b1f-4c63-8d88-2665548b79e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "610bdabd-1b26-4afa-9250-4e53c521eb0c", "tag": "479d04c0-250f-4afc-8065-5f7fc9611394"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:05.828137 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:05.828137 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:09:05.840551 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-0473bce6-9092-4d0d-87e2-78e1b49d20e0 req-b484513a-2b1f-4c63-8d88-2665548b79e3 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:05.840996 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-0473bce6-9092-4d0d-87e2-78e1b49d20e0 req-b484513a-2b1f-4c63-8d88-2665548b79e3 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:05.852447 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-0473bce6-9092-4d0d-87e2-78e1b49d20e0 req-b484513a-2b1f-4c63-8d88-2665548b79e3 service nova] Creating event network-changed:479d04c0-250f-4afc-8065-5f7fc9611394 for instance 610bdabd-1b26-4afa-9250-4e53c521eb0c on hv-cinder-66710 Nov 16 19:09:05.857787 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-0473bce6-9092-4d0d-87e2-78e1b49d20e0 req-b484513a-2b1f-4c63-8d88-2665548b79e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035082 Nov 16 19:09:05.858591 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 393/806] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:05.961103 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-43e75a97-2928-45ed-ba04-59a2d58a8b98 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:05.968342 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-43e75a97-2928-45ed-ba04-59a2d58a8b98 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.161309 Nov 16 19:09:05.968911 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 414/807] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:05 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:06.987118 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b10d42f3-343b-4ac6-955f-1421c7b416d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:06.987799 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b10d42f3-343b-4ac6-955f-1421c7b416d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:06.993797 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b10d42f3-343b-4ac6-955f-1421c7b416d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:06.994237 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b10d42f3-343b-4ac6-955f-1421c7b416d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:06.994990 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b10d42f3-343b-4ac6-955f-1421c7b416d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:06.996152 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b10d42f3-343b-4ac6-955f-1421c7b416d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:07.128715 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b10d42f3-343b-4ac6-955f-1421c7b416d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:07.135977 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b10d42f3-343b-4ac6-955f-1421c7b416d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.153212 Nov 16 19:09:07.137179 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 394/808] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:06 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:08.153683 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d7bb4051-6471-45bc-a006-996ffbf4bd9c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:08.154298 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d7bb4051-6471-45bc-a006-996ffbf4bd9c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:08.160488 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7bb4051-6471-45bc-a006-996ffbf4bd9c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:08.160938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7bb4051-6471-45bc-a006-996ffbf4bd9c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:08.161750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7bb4051-6471-45bc-a006-996ffbf4bd9c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:08.162189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7bb4051-6471-45bc-a006-996ffbf4bd9c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:08.287938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d7bb4051-6471-45bc-a006-996ffbf4bd9c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:08.295051 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d7bb4051-6471-45bc-a006-996ffbf4bd9c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.145648 Nov 16 19:09:08.295609 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 415/809] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:08 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:09.312224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7ec0736f-6ba8-4634-977c-325de474841d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:09.312802 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7ec0736f-6ba8-4634-977c-325de474841d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:09.319449 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ec0736f-6ba8-4634-977c-325de474841d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:09.319886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ec0736f-6ba8-4634-977c-325de474841d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:09.320646 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ec0736f-6ba8-4634-977c-325de474841d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:09.321069 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7ec0736f-6ba8-4634-977c-325de474841d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:09.457041 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7ec0736f-6ba8-4634-977c-325de474841d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:09.464123 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7ec0736f-6ba8-4634-977c-325de474841d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.156215 Nov 16 19:09:09.464713 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 395/810] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:09 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:10.481768 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-55facc63-32d5-4568-ad48-9e54c4520f9b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:10.482427 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-55facc63-32d5-4568-ad48-9e54c4520f9b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:10.489492 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55facc63-32d5-4568-ad48-9e54c4520f9b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:10.489914 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55facc63-32d5-4568-ad48-9e54c4520f9b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:10.490706 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55facc63-32d5-4568-ad48-9e54c4520f9b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:10.491156 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55facc63-32d5-4568-ad48-9e54c4520f9b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:10.625948 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55facc63-32d5-4568-ad48-9e54c4520f9b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:10.633737 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-55facc63-32d5-4568-ad48-9e54c4520f9b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.155648 Nov 16 19:09:10.634296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 416/811] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:10 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:11.650906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8832855c-1687-47aa-ab8a-a0204bffb8b9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:11.651511 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8832855c-1687-47aa-ab8a-a0204bffb8b9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:11.657941 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8832855c-1687-47aa-ab8a-a0204bffb8b9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:11.658384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8832855c-1687-47aa-ab8a-a0204bffb8b9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:11.659149 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8832855c-1687-47aa-ab8a-a0204bffb8b9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:11.659571 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8832855c-1687-47aa-ab8a-a0204bffb8b9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:11.791511 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-8832855c-1687-47aa-ab8a-a0204bffb8b9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:11.799323 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8832855c-1687-47aa-ab8a-a0204bffb8b9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.152138 Nov 16 19:09:11.799894 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 396/812] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:11 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:12.816643 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d81cdf23-f15b-4089-a6d5-a225400fa3d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:12.817199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d81cdf23-f15b-4089-a6d5-a225400fa3d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:12.823326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d81cdf23-f15b-4089-a6d5-a225400fa3d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:12.823776 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d81cdf23-f15b-4089-a6d5-a225400fa3d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:12.824537 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d81cdf23-f15b-4089-a6d5-a225400fa3d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:12.824965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d81cdf23-f15b-4089-a6d5-a225400fa3d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:12.951281 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d81cdf23-f15b-4089-a6d5-a225400fa3d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:12.958882 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d81cdf23-f15b-4089-a6d5-a225400fa3d8 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.146005 Nov 16 19:09:12.959437 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 417/813] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:12 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:09:13.975968 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b294fb7d-deae-441c-bc85-29a4e95933cf tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:13.976609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b294fb7d-deae-441c-bc85-29a4e95933cf tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:13.982912 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b294fb7d-deae-441c-bc85-29a4e95933cf tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:13.984176 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b294fb7d-deae-441c-bc85-29a4e95933cf tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:13.984176 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b294fb7d-deae-441c-bc85-29a4e95933cf tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:13.984554 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b294fb7d-deae-441c-bc85-29a4e95933cf tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:14.119368 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b294fb7d-deae-441c-bc85-29a4e95933cf tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:14.127836 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b294fb7d-deae-441c-bc85-29a4e95933cf tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.155511 Nov 16 19:09:14.128499 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 397/814] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:13 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:14.130447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-a0654dd3-c3f3-42c3-bf52-129c57babbb9 req-b818cc19-ecd5-41a2-a7fe-3891ce6eec66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "610bdabd-1b26-4afa-9250-4e53c521eb0c", "name": "network-vif-plugged", "status": "completed", "tag": "479d04c0-250f-4afc-8065-5f7fc9611394"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:14.132121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:14.132121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:09:14.139848 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-a0654dd3-c3f3-42c3-bf52-129c57babbb9 req-b818cc19-ecd5-41a2-a7fe-3891ce6eec66 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:14.140472 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-a0654dd3-c3f3-42c3-bf52-129c57babbb9 req-b818cc19-ecd5-41a2-a7fe-3891ce6eec66 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:14.159173 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-a0654dd3-c3f3-42c3-bf52-129c57babbb9 req-b818cc19-ecd5-41a2-a7fe-3891ce6eec66 service nova] Creating event network-vif-plugged:479d04c0-250f-4afc-8065-5f7fc9611394 for instance 610bdabd-1b26-4afa-9250-4e53c521eb0c on hv-cinder-66710 Nov 16 19:09:14.163930 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-a0654dd3-c3f3-42c3-bf52-129c57babbb9 req-b818cc19-ecd5-41a2-a7fe-3891ce6eec66 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037354 Nov 16 19:09:14.164603 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 418/815] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:15.145662 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b4711076-695a-44c5-bfd6-690b8c49196c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:15.146368 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b4711076-695a-44c5-bfd6-690b8c49196c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:15.153337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b4711076-695a-44c5-bfd6-690b8c49196c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:15.153823 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b4711076-695a-44c5-bfd6-690b8c49196c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:15.154630 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b4711076-695a-44c5-bfd6-690b8c49196c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:15.155250 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b4711076-695a-44c5-bfd6-690b8c49196c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:15.324277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b4711076-695a-44c5-bfd6-690b8c49196c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:15.331710 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b4711076-695a-44c5-bfd6-690b8c49196c tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1318 microversion: 2.1 time: 0.190013 Nov 16 19:09:15.332361 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 398/816] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:15 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:16.349385 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3ba11ef7-f97f-4105-9926-861d46684e89 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:16.350110 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3ba11ef7-f97f-4105-9926-861d46684e89 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:16.356006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ba11ef7-f97f-4105-9926-861d46684e89 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:16.356665 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ba11ef7-f97f-4105-9926-861d46684e89 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:16.357442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ba11ef7-f97f-4105-9926-861d46684e89 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:16.357905 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3ba11ef7-f97f-4105-9926-861d46684e89 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:16.489048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3ba11ef7-f97f-4105-9926-861d46684e89 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:16.496677 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3ba11ef7-f97f-4105-9926-861d46684e89 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1508 microversion: 2.1 time: 0.151650 Nov 16 19:09:16.497236 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 419/817] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:16 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:17.809869 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c302a6ec-fdf7-469a-82f8-69bc7d943122 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1c4f4d6-8460-4857-8401-1cfe234773a6"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:17.811043 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c302a6ec-fdf7-469a-82f8-69bc7d943122 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:17.817889 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c302a6ec-fdf7-469a-82f8-69bc7d943122 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:17.818437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c302a6ec-fdf7-469a-82f8-69bc7d943122 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:17.819274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c302a6ec-fdf7-469a-82f8-69bc7d943122 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:17.819776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c302a6ec-fdf7-469a-82f8-69bc7d943122 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:18.053323 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c302a6ec-fdf7-469a-82f8-69bc7d943122 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "POST /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247178 Nov 16 19:09:18.054127 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 399/818] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:09:17 2021] POST /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:25.615642 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6e634598-f203-4dc6-8f24-f5c42513c18a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:25.616180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6e634598-f203-4dc6-8f24-f5c42513c18a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:25.622781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e634598-f203-4dc6-8f24-f5c42513c18a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:25.623306 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e634598-f203-4dc6-8f24-f5c42513c18a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:25.624224 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e634598-f203-4dc6-8f24-f5c42513c18a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:25.624778 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6e634598-f203-4dc6-8f24-f5c42513c18a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:25.700794 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-6e634598-f203-4dc6-8f24-f5c42513c18a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lazy-loading 'services' on Instance uuid 610bdabd-1b26-4afa-9250-4e53c521eb0c {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:09:25.768258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6e634598-f203-4dc6-8f24-f5c42513c18a tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "DELETE /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c/os-volume_attachments/c1c4f4d6-8460-4857-8401-1cfe234773a6" status: 202 len: 0 microversion: 2.1 time: 0.156130 Nov 16 19:09:25.768833 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 420/819] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:09:25 2021] DELETE /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c/os-volume_attachments/c1c4f4d6-8460-4857-8401-1cfe234773a6 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:09:25.778277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-881b84be-2d33-44ec-9446-c7c5e4ce626d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:25.779277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-881b84be-2d33-44ec-9446-c7c5e4ce626d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:25.786572 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-881b84be-2d33-44ec-9446-c7c5e4ce626d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:25.786899 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-881b84be-2d33-44ec-9446-c7c5e4ce626d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:25.787689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-881b84be-2d33-44ec-9446-c7c5e4ce626d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:25.788118 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-881b84be-2d33-44ec-9446-c7c5e4ce626d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:25.817739 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-881b84be-2d33-44ec-9446-c7c5e4ce626d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043984 Nov 16 19:09:25.818294 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 400/820] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:09:25 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:26.829986 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-35e17d16-67ff-4d15-985a-6090c77c7b87 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:26.830916 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-35e17d16-67ff-4d15-985a-6090c77c7b87 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:26.836930 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-35e17d16-67ff-4d15-985a-6090c77c7b87 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:26.837371 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-35e17d16-67ff-4d15-985a-6090c77c7b87 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:26.838166 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-35e17d16-67ff-4d15-985a-6090c77c7b87 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:26.838600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-35e17d16-67ff-4d15-985a-6090c77c7b87 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:26.868034 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-35e17d16-67ff-4d15-985a-6090c77c7b87 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042972 Nov 16 19:09:26.869369 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 421/821] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:09:26 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:09:28.050194 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0ff2f15a-c55b-4d7a-9120-950edd5871c7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:28.050720 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0ff2f15a-c55b-4d7a-9120-950edd5871c7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:28.056948 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0ff2f15a-c55b-4d7a-9120-950edd5871c7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:28.057396 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0ff2f15a-c55b-4d7a-9120-950edd5871c7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:28.058220 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0ff2f15a-c55b-4d7a-9120-950edd5871c7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:28.058652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0ff2f15a-c55b-4d7a-9120-950edd5871c7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:28.082792 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0ff2f15a-c55b-4d7a-9120-950edd5871c7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:09:28.155867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0ff2f15a-c55b-4d7a-9120-950edd5871c7 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "DELETE /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 204 len: 0 microversion: 2.1 time: 0.109377 Nov 16 19:09:28.156679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 401/822] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:09:28 2021] DELETE /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:09:28.166129 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-818104a3-1e3c-4034-921c-538107937155 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:28.166738 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-818104a3-1e3c-4034-921c-538107937155 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:28.172926 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-818104a3-1e3c-4034-921c-538107937155 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:28.173376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-818104a3-1e3c-4034-921c-538107937155 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:28.174233 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-818104a3-1e3c-4034-921c-538107937155 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:28.174672 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-818104a3-1e3c-4034-921c-538107937155 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:28.310348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-818104a3-1e3c-4034-921c-538107937155 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:28.317489 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-818104a3-1e3c-4034-921c-538107937155 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1514 microversion: 2.1 time: 0.156121 Nov 16 19:09:28.318091 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 422/823] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:28 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:29.335663 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6cbce893-9b78-41db-bb4d-b21d86e2fce2 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:29.336346 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6cbce893-9b78-41db-bb4d-b21d86e2fce2 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:29.342766 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6cbce893-9b78-41db-bb4d-b21d86e2fce2 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:29.343192 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6cbce893-9b78-41db-bb4d-b21d86e2fce2 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:29.343968 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6cbce893-9b78-41db-bb4d-b21d86e2fce2 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:29.344403 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6cbce893-9b78-41db-bb4d-b21d86e2fce2 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:29.476047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6cbce893-9b78-41db-bb4d-b21d86e2fce2 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:29.484117 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6cbce893-9b78-41db-bb4d-b21d86e2fce2 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1514 microversion: 2.1 time: 0.152418 Nov 16 19:09:29.484985 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 402/824] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:29 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:30.500018 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6bc96be1-8f2f-4659-ae0b-8c88788eef70 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:30.501264 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6bc96be1-8f2f-4659-ae0b-8c88788eef70 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:30.507560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bc96be1-8f2f-4659-ae0b-8c88788eef70 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:30.508007 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bc96be1-8f2f-4659-ae0b-8c88788eef70 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:30.508778 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bc96be1-8f2f-4659-ae0b-8c88788eef70 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:30.509215 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bc96be1-8f2f-4659-ae0b-8c88788eef70 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:30.650922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6bc96be1-8f2f-4659-ae0b-8c88788eef70 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:30.661790 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6bc96be1-8f2f-4659-ae0b-8c88788eef70 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 200 len: 1514 microversion: 2.1 time: 0.165269 Nov 16 19:09:30.662831 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 423/825] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:30 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:30.687039 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-51becfc0-9486-4f38-9642-bcefa14f9e22 req-bf17adfc-e9f1-4e09-91bc-7dbb80a4af85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "610bdabd-1b26-4afa-9250-4e53c521eb0c", "name": "network-vif-deleted", "tag": "479d04c0-250f-4afc-8065-5f7fc9611394"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:30.689152 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:30.689152 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:09:30.696917 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-51becfc0-9486-4f38-9642-bcefa14f9e22 req-bf17adfc-e9f1-4e09-91bc-7dbb80a4af85 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:30.697350 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-51becfc0-9486-4f38-9642-bcefa14f9e22 req-bf17adfc-e9f1-4e09-91bc-7dbb80a4af85 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:30.708316 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-51becfc0-9486-4f38-9642-bcefa14f9e22 req-bf17adfc-e9f1-4e09-91bc-7dbb80a4af85 service nova] Creating event network-vif-deleted:479d04c0-250f-4afc-8065-5f7fc9611394 for instance 610bdabd-1b26-4afa-9250-4e53c521eb0c on hv-cinder-66710 Nov 16 19:09:30.714042 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-51becfc0-9486-4f38-9642-bcefa14f9e22 req-bf17adfc-e9f1-4e09-91bc-7dbb80a4af85 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030227 Nov 16 19:09:30.714650 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 403/826] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:31.678976 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:31.679585 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 610bdabd-1b26-4afa-9250-4e53c521eb0c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:31.686185 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:31.686636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:31.687417 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:31.687863 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:31.700597 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] HTTP exception thrown: Instance 610bdabd-1b26-4afa-9250-4e53c521eb0c could not be found. Nov 16 19:09:31.701190 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Returning 404 to user: Instance 610bdabd-1b26-4afa-9250-4e53c521eb0c could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:09:31.702148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e39d5aa4-284c-4953-9b5c-71c475d6a6a9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c" status: 404 len: 111 microversion: 2.1 time: 0.026777 Nov 16 19:09:31.702666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 424/827] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:31 2021] GET /compute/v2.1/servers/610bdabd-1b26-4afa-9250-4e53c521eb0c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:09:32.832303 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d88ba854-5997-4751-9761-4be91b131308 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:32.832870 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d88ba854-5997-4751-9761-4be91b131308 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:32.838784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d88ba854-5997-4751-9761-4be91b131308 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:32.839224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d88ba854-5997-4751-9761-4be91b131308 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:32.839979 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d88ba854-5997-4751-9761-4be91b131308 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:32.840403 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d88ba854-5997-4751-9761-4be91b131308 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:32.864262 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d88ba854-5997-4751-9761-4be91b131308 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:09:32.940803 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d88ba854-5997-4751-9761-4be91b131308 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "DELETE /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 204 len: 0 microversion: 2.1 time: 0.113026 Nov 16 19:09:32.941296 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 404/828] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:09:32 2021] DELETE /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:09:32.949758 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1f19ec14-cf7b-4dfb-a5d1-efc5891261c3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:32.950397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1f19ec14-cf7b-4dfb-a5d1-efc5891261c3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:32.957463 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1f19ec14-cf7b-4dfb-a5d1-efc5891261c3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:32.957930 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1f19ec14-cf7b-4dfb-a5d1-efc5891261c3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:32.958698 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1f19ec14-cf7b-4dfb-a5d1-efc5891261c3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:32.959129 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1f19ec14-cf7b-4dfb-a5d1-efc5891261c3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:33.092999 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1f19ec14-cf7b-4dfb-a5d1-efc5891261c3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:33.100270 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1f19ec14-cf7b-4dfb-a5d1-efc5891261c3 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1515 microversion: 2.1 time: 0.154188 Nov 16 19:09:33.100827 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 425/829] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:32 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:34.117535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-980860db-f60d-40d3-9b94-e8cb2d245566 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:34.118251 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-980860db-f60d-40d3-9b94-e8cb2d245566 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:34.124391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-980860db-f60d-40d3-9b94-e8cb2d245566 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:34.124826 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-980860db-f60d-40d3-9b94-e8cb2d245566 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:34.125612 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-980860db-f60d-40d3-9b94-e8cb2d245566 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:34.126292 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-980860db-f60d-40d3-9b94-e8cb2d245566 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:34.255391 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-980860db-f60d-40d3-9b94-e8cb2d245566 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:34.262992 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-980860db-f60d-40d3-9b94-e8cb2d245566 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1515 microversion: 2.1 time: 0.149469 Nov 16 19:09:34.263544 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 405/830] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:34 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:35.279951 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b27849c1-2666-4d4d-9da9-052b07c830ab tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:35.280541 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b27849c1-2666-4d4d-9da9-052b07c830ab tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:35.287925 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b27849c1-2666-4d4d-9da9-052b07c830ab tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:35.288368 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b27849c1-2666-4d4d-9da9-052b07c830ab tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:35.289377 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b27849c1-2666-4d4d-9da9-052b07c830ab tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:35.289816 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b27849c1-2666-4d4d-9da9-052b07c830ab tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:35.356071 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b27849c1-2666-4d4d-9da9-052b07c830ab tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:35.369689 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b27849c1-2666-4d4d-9da9-052b07c830ab tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 200 len: 1473 microversion: 2.1 time: 0.093215 Nov 16 19:09:35.370265 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 426/831] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:35 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 1473 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:35.380089 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-95d4d4de-105f-4357-bd97-f77855d18f6a req-73cce52a-2afe-4f30-aec7-c6eaa55869aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aab4024-3d77-4531-a0d5-4fd77dd7e7bb", "name": "network-vif-deleted", "tag": "ffe6f08b-8236-468c-9d55-7fe6ddacd142"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:35.381949 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:35.381949 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:09:35.392417 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-95d4d4de-105f-4357-bd97-f77855d18f6a req-73cce52a-2afe-4f30-aec7-c6eaa55869aa service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:35.392847 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-95d4d4de-105f-4357-bd97-f77855d18f6a req-73cce52a-2afe-4f30-aec7-c6eaa55869aa service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:35.407635 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-95d4d4de-105f-4357-bd97-f77855d18f6a req-73cce52a-2afe-4f30-aec7-c6eaa55869aa service nova] Creating event network-vif-deleted:ffe6f08b-8236-468c-9d55-7fe6ddacd142 for instance 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb on hv-cinder-66710 Nov 16 19:09:35.413756 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-95d4d4de-105f-4357-bd97-f77855d18f6a req-73cce52a-2afe-4f30-aec7-c6eaa55869aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037508 Nov 16 19:09:35.414372 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 406/832] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:36.386864 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:36.387474 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:36.393842 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:36.394289 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:36.395060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:36.395499 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:36.408001 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] HTTP exception thrown: Instance 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb could not be found. Nov 16 19:09:36.408608 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Returning 404 to user: Instance 9aab4024-3d77-4531-a0d5-4fd77dd7e7bb could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:09:36.409448 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-37649a84-7a17-4dc6-810b-9e0527c3fd45 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb" status: 404 len: 111 microversion: 2.1 time: 0.026339 Nov 16 19:09:36.409986 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 427/833] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:36 2021] GET /compute/v2.1/servers/9aab4024-3d77-4531-a0d5-4fd77dd7e7bb => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:09:36.418310 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bc9f90c3-8658-4c20-8f40-d926bffc49b1 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:36.418877 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bc9f90c3-8658-4c20-8f40-d926bffc49b1 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:36.425702 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc9f90c3-8658-4c20-8f40-d926bffc49b1 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:36.426144 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc9f90c3-8658-4c20-8f40-d926bffc49b1 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:36.426907 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc9f90c3-8658-4c20-8f40-d926bffc49b1 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:36.427457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc9f90c3-8658-4c20-8f40-d926bffc49b1 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:36.453270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bc9f90c3-8658-4c20-8f40-d926bffc49b1 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:09:36.541822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bc9f90c3-8658-4c20-8f40-d926bffc49b1 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "DELETE /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 204 len: 0 microversion: 2.1 time: 0.127070 Nov 16 19:09:36.542607 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 407/834] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:09:36 2021] DELETE /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:09:36.550943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-92f14761-2432-4b97-8b33-d0164743bb5b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:36.551908 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-92f14761-2432-4b97-8b33-d0164743bb5b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:36.557800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92f14761-2432-4b97-8b33-d0164743bb5b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:36.558244 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92f14761-2432-4b97-8b33-d0164743bb5b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:36.559030 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92f14761-2432-4b97-8b33-d0164743bb5b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:36.559452 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92f14761-2432-4b97-8b33-d0164743bb5b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:36.689776 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-92f14761-2432-4b97-8b33-d0164743bb5b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:36.697445 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-92f14761-2432-4b97-8b33-d0164743bb5b tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1513 microversion: 2.1 time: 0.151015 Nov 16 19:09:36.698035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 428/835] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:36 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:37.715145 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0eee1012-7f23-4738-b336-8342ac3639b6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:37.715861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0eee1012-7f23-4738-b336-8342ac3639b6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:37.722079 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0eee1012-7f23-4738-b336-8342ac3639b6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:37.722522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0eee1012-7f23-4738-b336-8342ac3639b6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:37.723287 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0eee1012-7f23-4738-b336-8342ac3639b6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:37.723717 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0eee1012-7f23-4738-b336-8342ac3639b6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:37.858033 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0eee1012-7f23-4738-b336-8342ac3639b6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:37.865839 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0eee1012-7f23-4738-b336-8342ac3639b6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1513 microversion: 2.1 time: 0.154784 Nov 16 19:09:37.866402 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 408/836] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:37 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:38.440636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-41085cbf-a26e-404e-b4d2-ca1d5021c8d1 req-80eaa3bd-076f-46b0-9caa-68f44a9f1ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526863d1-282a-4442-8260-50cbaec699eb", "name": "network-vif-deleted", "tag": "399dbb90-f15a-45a3-bcd8-026172ae7de5"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:38.442348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:38.442348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:09:38.456433 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-41085cbf-a26e-404e-b4d2-ca1d5021c8d1 req-80eaa3bd-076f-46b0-9caa-68f44a9f1ea1 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:38.457372 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-41085cbf-a26e-404e-b4d2-ca1d5021c8d1 req-80eaa3bd-076f-46b0-9caa-68f44a9f1ea1 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:38.479387 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-41085cbf-a26e-404e-b4d2-ca1d5021c8d1 req-80eaa3bd-076f-46b0-9caa-68f44a9f1ea1 service nova] Creating event network-vif-deleted:399dbb90-f15a-45a3-bcd8-026172ae7de5 for instance 526863d1-282a-4442-8260-50cbaec699eb on hv-cinder-66710 Nov 16 19:09:38.490599 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-41085cbf-a26e-404e-b4d2-ca1d5021c8d1 req-80eaa3bd-076f-46b0-9caa-68f44a9f1ea1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053431 Nov 16 19:09:38.491866 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 429/837] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:38.882503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:38.883104 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:38.889376 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:38.890114 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:38.890876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:38.891281 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:38.923229 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:38.923677 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:38.924754 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lazy-loading 'fault' on Instance uuid 526863d1-282a-4442-8260-50cbaec699eb {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:09:38.969092 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:38.980658 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fb742d36-3d81-410e-9e7f-2941e541a9d6 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 200 len: 1307 microversion: 2.1 time: 0.101663 Nov 16 19:09:38.981930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 409/838] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:38 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:39.998659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:39.999450 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 526863d1-282a-4442-8260-50cbaec699eb] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:40.006955 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:40.007507 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:40.008483 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:40.009030 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:40.022429 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] HTTP exception thrown: Instance 526863d1-282a-4442-8260-50cbaec699eb could not be found. Nov 16 19:09:40.023021 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Returning 404 to user: Instance 526863d1-282a-4442-8260-50cbaec699eb could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:09:40.023854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-969316ea-f30c-4daf-84bb-35b6f142ad55 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb" status: 404 len: 111 microversion: 2.1 time: 0.029217 Nov 16 19:09:40.024398 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 430/839] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:39 2021] GET /compute/v2.1/servers/526863d1-282a-4442-8260-50cbaec699eb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:09:41.154067 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c2c4d036-ab43-4ebb-89c1-18ccc7b395a5 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:41.154552 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c2c4d036-ab43-4ebb-89c1-18ccc7b395a5 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:41.161293 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c2c4d036-ab43-4ebb-89c1-18ccc7b395a5 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:41.161768 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c2c4d036-ab43-4ebb-89c1-18ccc7b395a5 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:41.162535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c2c4d036-ab43-4ebb-89c1-18ccc7b395a5 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:41.162964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c2c4d036-ab43-4ebb-89c1-18ccc7b395a5 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:41.186428 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c2c4d036-ab43-4ebb-89c1-18ccc7b395a5 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:09:41.261153 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c2c4d036-ab43-4ebb-89c1-18ccc7b395a5 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 204 len: 0 microversion: 2.1 time: 0.110123 Nov 16 19:09:41.262604 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 410/840] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:09:41 2021] DELETE /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:09:41.270039 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3d734624-8fd7-4844-b390-9e85ca5dde18 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:41.270646 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3d734624-8fd7-4844-b390-9e85ca5dde18 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:41.276791 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d734624-8fd7-4844-b390-9e85ca5dde18 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:41.277236 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d734624-8fd7-4844-b390-9e85ca5dde18 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:41.278064 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d734624-8fd7-4844-b390-9e85ca5dde18 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:41.278493 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d734624-8fd7-4844-b390-9e85ca5dde18 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:41.413920 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3d734624-8fd7-4844-b390-9e85ca5dde18 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:41.421284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3d734624-8fd7-4844-b390-9e85ca5dde18 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1514 microversion: 2.1 time: 0.154899 Nov 16 19:09:41.421861 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 431/841] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:41 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:41.730091 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-59256298", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "6e6e95fe-670f-4ef8-b884-60e8070d32d6"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:41.779720 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] validate_networks() for [('6e6e95fe-670f-4ef8-b884-60e8070d32d6', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:09:42.113733 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:09:42.114151 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:09:42.114616 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:09:42.115017 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:09:42.115417 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:09:42.123680 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:42.124117 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:42.124934 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:42.125357 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:42.141471 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Getting quotas for project e543afad06c44fc192c42924e11befdd. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:09:42.145903 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Getting quotas for user 2e887ab0d91d4dd9bc9c189c0c4070c0 and project e543afad06c44fc192c42924e11befdd. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:09:42.156168 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:09:42.158540 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:09:42.202365 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-04c5a4cb-f502-451b-9c2a-81e65d35d582 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.476096 Nov 16 19:09:42.202933 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 411/842] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:09:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:09:42.213463 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f64e010c-a659-44c8-9b46-612b098245e1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:42.214115 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f64e010c-a659-44c8-9b46-612b098245e1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:42.269579 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f64e010c-a659-44c8-9b46-612b098245e1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:42.276407 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f64e010c-a659-44c8-9b46-612b098245e1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1212 microversion: 2.1 time: 0.066870 Nov 16 19:09:42.277121 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 432/843] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:42 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1212 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:42.438051 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c9035f56-b36d-4da7-9fc9-b6a214777c12 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:42.438660 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c9035f56-b36d-4da7-9fc9-b6a214777c12 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:42.447399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9035f56-b36d-4da7-9fc9-b6a214777c12 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:42.447850 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9035f56-b36d-4da7-9fc9-b6a214777c12 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:42.448627 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9035f56-b36d-4da7-9fc9-b6a214777c12 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:42.449059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c9035f56-b36d-4da7-9fc9-b6a214777c12 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:42.588928 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c9035f56-b36d-4da7-9fc9-b6a214777c12 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:42.596190 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c9035f56-b36d-4da7-9fc9-b6a214777c12 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1514 microversion: 2.1 time: 0.161896 Nov 16 19:09:42.596748 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 412/844] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:42 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:43.293820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ff482043-c334-4f48-9c5a-7d0069de480e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:43.294455 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ff482043-c334-4f48-9c5a-7d0069de480e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:43.302033 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff482043-c334-4f48-9c5a-7d0069de480e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:43.302481 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff482043-c334-4f48-9c5a-7d0069de480e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:43.303403 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff482043-c334-4f48-9c5a-7d0069de480e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:43.303835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff482043-c334-4f48-9c5a-7d0069de480e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:43.371061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ff482043-c334-4f48-9c5a-7d0069de480e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:43.379483 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ff482043-c334-4f48-9c5a-7d0069de480e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1270 microversion: 2.1 time: 0.089283 Nov 16 19:09:43.389384 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 433/845] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:43 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:43.484657 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-ddcb103c-8fac-46a8-99ef-745021465ea3 req-54879083-ba47-4685-be46-9865dae15f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e52ea22-a91d-49af-bb25-1b1d20df5768", "name": "network-vif-deleted", "tag": "8e5b3f73-ec0e-4a71-9000-d46d548d6adf"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:43.487679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:43.487679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:09:43.495057 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-ddcb103c-8fac-46a8-99ef-745021465ea3 req-54879083-ba47-4685-be46-9865dae15f9a service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:43.495499 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-ddcb103c-8fac-46a8-99ef-745021465ea3 req-54879083-ba47-4685-be46-9865dae15f9a service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:43.508538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-ddcb103c-8fac-46a8-99ef-745021465ea3 req-54879083-ba47-4685-be46-9865dae15f9a service nova] Creating event network-vif-deleted:8e5b3f73-ec0e-4a71-9000-d46d548d6adf for instance 0e52ea22-a91d-49af-bb25-1b1d20df5768 on hv-cinder-66710 Nov 16 19:09:43.514793 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-ddcb103c-8fac-46a8-99ef-745021465ea3 req-54879083-ba47-4685-be46-9865dae15f9a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Nov 16 19:09:43.517032 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 413/846] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:43.615039 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:43.615834 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:43.623872 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:43.624325 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:43.626422 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:43.626868 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:43.657439 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:43.657923 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:43.658908 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lazy-loading 'fault' on Instance uuid 0e52ea22-a91d-49af-bb25-1b1d20df5768 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:09:43.697970 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '846d3005576a460cba07a39ee8596699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94b91bcf959046d98ee0e24ab094216b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:43.705350 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1eb9d5b9-b93c-4068-bff8-d5d413f3d8e9 tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 200 len: 1308 microversion: 2.1 time: 0.095902 Nov 16 19:09:43.705950 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 434/847] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:43 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:44.396261 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-954f4a7b-4ed8-4484-bab8-800ceff0cc59 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:44.396930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-954f4a7b-4ed8-4484-bab8-800ceff0cc59 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:44.402791 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-954f4a7b-4ed8-4484-bab8-800ceff0cc59 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:44.403231 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-954f4a7b-4ed8-4484-bab8-800ceff0cc59 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:44.403991 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-954f4a7b-4ed8-4484-bab8-800ceff0cc59 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:44.404418 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-954f4a7b-4ed8-4484-bab8-800ceff0cc59 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:44.629802 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-954f4a7b-4ed8-4484-bab8-800ceff0cc59 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:44.637023 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-954f4a7b-4ed8-4484-bab8-800ceff0cc59 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1312 microversion: 2.1 time: 0.244729 Nov 16 19:09:44.637602 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 414/848] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:44 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:44.722104 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:44.722714 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] [instance: 0e52ea22-a91d-49af-bb25-1b1d20df5768] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:44.729138 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:44.729645 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:44.730540 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:44.730851 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:44.744507 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] HTTP exception thrown: Instance 0e52ea22-a91d-49af-bb25-1b1d20df5768 could not be found. Nov 16 19:09:44.745027 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] Returning 404 to user: Instance 0e52ea22-a91d-49af-bb25-1b1d20df5768 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:09:44.745901 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7f55cfc3-f971-4e72-a964-20ce9696ec6d tempest-AttachVolumeNegativeTest-873924784 tempest-AttachVolumeNegativeTest-873924784-project] 10.222.0.46 "GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768" status: 404 len: 111 microversion: 2.1 time: 0.027435 Nov 16 19:09:44.746437 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 435/849] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:44 2021] GET /compute/v2.1/servers/0e52ea22-a91d-49af-bb25-1b1d20df5768 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:09:45.555286 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-dde2af15-a46f-449e-8d9b-443653a239e4 req-02e99ddd-8972-4393-8467-c05219300657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e040ad3-a5e8-43fc-b4a1-da011ee77e6f", "tag": "e5d72c58-4a28-44bf-a9be-95cd62952aae"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:45.556704 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:45.556704 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:09:45.563781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-dde2af15-a46f-449e-8d9b-443653a239e4 req-02e99ddd-8972-4393-8467-c05219300657 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:45.564253 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-dde2af15-a46f-449e-8d9b-443653a239e4 req-02e99ddd-8972-4393-8467-c05219300657 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:45.575435 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-dde2af15-a46f-449e-8d9b-443653a239e4 req-02e99ddd-8972-4393-8467-c05219300657 service nova] Creating event network-changed:e5d72c58-4a28-44bf-a9be-95cd62952aae for instance 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f on hv-cinder-66710 Nov 16 19:09:45.580181 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-dde2af15-a46f-449e-8d9b-443653a239e4 req-02e99ddd-8972-4393-8467-c05219300657 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028480 Nov 16 19:09:45.580648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 415/850] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:45.653696 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-880ae519-a0da-4df3-9d59-a599cac146c6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:45.654515 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-880ae519-a0da-4df3-9d59-a599cac146c6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:45.661690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-880ae519-a0da-4df3-9d59-a599cac146c6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:45.662101 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-880ae519-a0da-4df3-9d59-a599cac146c6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:45.663010 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-880ae519-a0da-4df3-9d59-a599cac146c6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:45.663460 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-880ae519-a0da-4df3-9d59-a599cac146c6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:45.805938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-880ae519-a0da-4df3-9d59-a599cac146c6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:45.813636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-880ae519-a0da-4df3-9d59-a599cac146c6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1312 microversion: 2.1 time: 0.163806 Nov 16 19:09:45.814226 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 436/851] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:45 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:46.832285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6a042d4c-5ba6-434b-a1a3-6ec8e4b5dac5 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:46.832978 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6a042d4c-5ba6-434b-a1a3-6ec8e4b5dac5 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:46.839285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6a042d4c-5ba6-434b-a1a3-6ec8e4b5dac5 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:46.839727 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6a042d4c-5ba6-434b-a1a3-6ec8e4b5dac5 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:46.840500 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6a042d4c-5ba6-434b-a1a3-6ec8e4b5dac5 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:46.840930 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6a042d4c-5ba6-434b-a1a3-6ec8e4b5dac5 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:46.975979 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6a042d4c-5ba6-434b-a1a3-6ec8e4b5dac5 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:46.983116 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6a042d4c-5ba6-434b-a1a3-6ec8e4b5dac5 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1312 microversion: 2.1 time: 0.156287 Nov 16 19:09:46.983686 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 416/852] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:46 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:48.000750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6731e654-d81d-4b69-8206-2ae6f8bf247b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:48.002125 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6731e654-d81d-4b69-8206-2ae6f8bf247b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:48.008684 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6731e654-d81d-4b69-8206-2ae6f8bf247b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:48.009240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6731e654-d81d-4b69-8206-2ae6f8bf247b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:48.010107 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6731e654-d81d-4b69-8206-2ae6f8bf247b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:48.010551 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6731e654-d81d-4b69-8206-2ae6f8bf247b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:48.143992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6731e654-d81d-4b69-8206-2ae6f8bf247b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:48.151394 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6731e654-d81d-4b69-8206-2ae6f8bf247b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1312 microversion: 2.1 time: 0.154608 Nov 16 19:09:48.151960 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 437/853] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:47 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:49.167583 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0de2c479-98cc-4f2a-9443-2080f3dad130 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:49.168225 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0de2c479-98cc-4f2a-9443-2080f3dad130 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:49.174625 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0de2c479-98cc-4f2a-9443-2080f3dad130 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:49.175095 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0de2c479-98cc-4f2a-9443-2080f3dad130 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:49.175876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0de2c479-98cc-4f2a-9443-2080f3dad130 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:49.176309 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0de2c479-98cc-4f2a-9443-2080f3dad130 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:49.313183 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0de2c479-98cc-4f2a-9443-2080f3dad130 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:49.321822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0de2c479-98cc-4f2a-9443-2080f3dad130 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1312 microversion: 2.1 time: 0.157691 Nov 16 19:09:49.322457 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 417/854] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:49 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:50.341410 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0edf8372-8423-4dbf-85dc-8fc5250e0796 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:50.346852 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0edf8372-8423-4dbf-85dc-8fc5250e0796 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:50.353139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0edf8372-8423-4dbf-85dc-8fc5250e0796 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:50.353835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0edf8372-8423-4dbf-85dc-8fc5250e0796 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:50.354619 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0edf8372-8423-4dbf-85dc-8fc5250e0796 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:50.355047 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0edf8372-8423-4dbf-85dc-8fc5250e0796 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:50.494539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-10b59da6-d23e-4cdb-a9eb-47e05a5a22d7 req-9229fe00-473e-453c-bf25-a5ff1ae473ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e040ad3-a5e8-43fc-b4a1-da011ee77e6f", "name": "network-vif-plugged", "status": "completed", "tag": "e5d72c58-4a28-44bf-a9be-95cd62952aae"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:50.496302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:50.496302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:09:50.507100 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-10b59da6-d23e-4cdb-a9eb-47e05a5a22d7 req-9229fe00-473e-453c-bf25-a5ff1ae473ee service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:50.507629 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-10b59da6-d23e-4cdb-a9eb-47e05a5a22d7 req-9229fe00-473e-453c-bf25-a5ff1ae473ee service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:50.519221 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-10b59da6-d23e-4cdb-a9eb-47e05a5a22d7 req-9229fe00-473e-453c-bf25-a5ff1ae473ee service nova] Creating event network-vif-plugged:e5d72c58-4a28-44bf-a9be-95cd62952aae for instance 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f on hv-cinder-66710 Nov 16 19:09:50.525116 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-10b59da6-d23e-4cdb-a9eb-47e05a5a22d7 req-9229fe00-473e-453c-bf25-a5ff1ae473ee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036044 Nov 16 19:09:50.526017 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 418/855] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:09:50.557383 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0edf8372-8423-4dbf-85dc-8fc5250e0796 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:50.567554 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0edf8372-8423-4dbf-85dc-8fc5250e0796 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1312 microversion: 2.1 time: 0.232614 Nov 16 19:09:50.568430 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 438/856] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:50 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1312 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:51.584289 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0035a3ee-1946-4554-8533-8b2649a7312f tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:51.585002 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0035a3ee-1946-4554-8533-8b2649a7312f tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:51.591239 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0035a3ee-1946-4554-8533-8b2649a7312f tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:51.591679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0035a3ee-1946-4554-8533-8b2649a7312f tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:51.592443 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0035a3ee-1946-4554-8533-8b2649a7312f tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:51.592866 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0035a3ee-1946-4554-8533-8b2649a7312f tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:51.724085 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0035a3ee-1946-4554-8533-8b2649a7312f tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:51.731458 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0035a3ee-1946-4554-8533-8b2649a7312f tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1312 microversion: 2.1 time: 0.151250 Nov 16 19:09:51.732016 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 419/857] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:51 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:52.748615 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-578aef63-5a44-40c9-9367-468015199367 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:52.749096 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-578aef63-5a44-40c9-9367-468015199367 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:52.756116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-578aef63-5a44-40c9-9367-468015199367 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:52.756755 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-578aef63-5a44-40c9-9367-468015199367 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:52.757538 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-578aef63-5a44-40c9-9367-468015199367 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:52.758001 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-578aef63-5a44-40c9-9367-468015199367 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:52.894383 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-578aef63-5a44-40c9-9367-468015199367 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:52.901918 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-578aef63-5a44-40c9-9367-468015199367 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1495 microversion: 2.1 time: 0.157008 Nov 16 19:09:52.902476 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 439/858] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:52 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1495 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:53.271950 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bc2c5dec-63fd-46ce-8f40-3cc34a19407d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:53.272486 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bc2c5dec-63fd-46ce-8f40-3cc34a19407d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:53.278322 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc2c5dec-63fd-46ce-8f40-3cc34a19407d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:53.278762 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc2c5dec-63fd-46ce-8f40-3cc34a19407d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:53.279550 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc2c5dec-63fd-46ce-8f40-3cc34a19407d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:53.279952 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc2c5dec-63fd-46ce-8f40-3cc34a19407d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:53.304999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bc2c5dec-63fd-46ce-8f40-3cc34a19407d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:09:53.379187 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bc2c5dec-63fd-46ce-8f40-3cc34a19407d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 204 len: 0 microversion: 2.1 time: 0.110833 Nov 16 19:09:53.379817 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 420/859] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:09:53 2021] DELETE /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:09:53.388957 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0a21fc99-8e81-4f1f-9f54-f21dd845e24b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:53.389684 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0a21fc99-8e81-4f1f-9f54-f21dd845e24b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:53.395518 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a21fc99-8e81-4f1f-9f54-f21dd845e24b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:53.396043 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a21fc99-8e81-4f1f-9f54-f21dd845e24b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:53.396938 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a21fc99-8e81-4f1f-9f54-f21dd845e24b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:53.397443 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a21fc99-8e81-4f1f-9f54-f21dd845e24b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:53.549838 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0a21fc99-8e81-4f1f-9f54-f21dd845e24b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:53.556966 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0a21fc99-8e81-4f1f-9f54-f21dd845e24b tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1501 microversion: 2.1 time: 0.171938 Nov 16 19:09:53.557521 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 440/860] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:53 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:54.574078 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-820cd566-cd23-4bf9-aa41-ea530b6653c0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:54.574856 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-820cd566-cd23-4bf9-aa41-ea530b6653c0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:54.581179 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-820cd566-cd23-4bf9-aa41-ea530b6653c0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:54.581687 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-820cd566-cd23-4bf9-aa41-ea530b6653c0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:54.582481 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-820cd566-cd23-4bf9-aa41-ea530b6653c0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:54.583147 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-820cd566-cd23-4bf9-aa41-ea530b6653c0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:54.729584 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-820cd566-cd23-4bf9-aa41-ea530b6653c0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:54.737446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-820cd566-cd23-4bf9-aa41-ea530b6653c0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1501 microversion: 2.1 time: 0.167455 Nov 16 19:09:54.738059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 421/861] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:54 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:55.484362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-7d5f5ac1-1a69-4162-a9c4-4a23e42f305e req-f8a2bb13-8e7e-4585-8673-1d3e92bfaecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e040ad3-a5e8-43fc-b4a1-da011ee77e6f", "name": "network-vif-deleted", "tag": "e5d72c58-4a28-44bf-a9be-95cd62952aae"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:55.486683 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:55.486683 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:09:55.494231 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-7d5f5ac1-1a69-4162-a9c4-4a23e42f305e req-f8a2bb13-8e7e-4585-8673-1d3e92bfaecf service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:55.494762 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-7d5f5ac1-1a69-4162-a9c4-4a23e42f305e req-f8a2bb13-8e7e-4585-8673-1d3e92bfaecf service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:55.506144 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-7d5f5ac1-1a69-4162-a9c4-4a23e42f305e req-f8a2bb13-8e7e-4585-8673-1d3e92bfaecf service nova] Creating event network-vif-deleted:e5d72c58-4a28-44bf-a9be-95cd62952aae for instance 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f on hv-cinder-66710 Nov 16 19:09:55.511385 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-7d5f5ac1-1a69-4162-a9c4-4a23e42f305e req-f8a2bb13-8e7e-4585-8673-1d3e92bfaecf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030797 Nov 16 19:09:55.512168 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 441/862] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:09:55.754949 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:55.755726 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:55.761722 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:55.762167 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:55.762940 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:55.763368 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:55.793878 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:55.794328 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:55.794764 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lazy-loading 'fault' on Instance uuid 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:09:55.835539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:55.845892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5c725c2d-9972-4538-8814-37d13c44601d tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 200 len: 1302 microversion: 2.1 time: 0.093418 Nov 16 19:09:55.846811 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 422/863] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:55 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:56.372224 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:09:56.372389 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: Tue Nov 16 19:09:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:09:56.864284 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:56.864984 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:56.870932 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:56.871381 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:56.872156 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:56.872591 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:56.885456 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] HTTP exception thrown: Instance 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f could not be found. Nov 16 19:09:56.886067 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Returning 404 to user: Instance 7e040ad3-a5e8-43fc-b4a1-da011ee77e6f could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:09:56.886875 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6afa3d4d-e7a4-4b87-a5dc-bd68873cb6f6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f" status: 404 len: 111 microversion: 2.1 time: 0.027144 Nov 16 19:09:56.887384 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 442/864] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:56 2021] GET /compute/v2.1/servers/7e040ad3-a5e8-43fc-b4a1-da011ee77e6f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:09:56.983446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1100476638", "imageRef": "513c72f3-3521-41e0-9dec-5075435d7a4e", "flavorRef": "452", "networks": [{"uuid": "6e6e95fe-670f-4ef8-b884-60e8070d32d6"}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:57.033692 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] validate_networks() for [('6e6e95fe-670f-4ef8-b884-60e8070d32d6', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:09:57.368473 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:09:57.368891 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:09:57.369390 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:09:57.369822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:09:57.370231 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:09:57.379607 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:57.380054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:57.380861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:57.381295 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:57.397217 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Getting quotas for project e543afad06c44fc192c42924e11befdd. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:09:57.401000 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Getting quotas for user 2e887ab0d91d4dd9bc9c189c0c4070c0 and project e543afad06c44fc192c42924e11befdd. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:09:57.411476 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:09:57.413810 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='513c72f3-3521-41e0-9dec-5075435d7a4e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:09:57.460629 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9126962d-6d3e-41ff-be7b-25b8a9714b23 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480731 Nov 16 19:09:57.461274 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 423/865] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:09:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:09:57.470964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cbd088f4-6381-4b8a-87a2-e49726e97ee0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:57.471697 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cbd088f4-6381-4b8a-87a2-e49726e97ee0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:57.523231 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cbd088f4-6381-4b8a-87a2-e49726e97ee0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:57.529623 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cbd088f4-6381-4b8a-87a2-e49726e97ee0 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1214 microversion: 2.1 time: 0.062292 Nov 16 19:09:57.530180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 443/866] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:57 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1214 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:58.546748 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-294fac10-7be8-4759-afae-8f2c33f27f71 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:58.547360 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-294fac10-7be8-4759-afae-8f2c33f27f71 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:58.553283 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-294fac10-7be8-4759-afae-8f2c33f27f71 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:58.553776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-294fac10-7be8-4759-afae-8f2c33f27f71 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:58.554540 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-294fac10-7be8-4759-afae-8f2c33f27f71 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:58.554967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-294fac10-7be8-4759-afae-8f2c33f27f71 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:58.646666 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-294fac10-7be8-4759-afae-8f2c33f27f71 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:58.654226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-294fac10-7be8-4759-afae-8f2c33f27f71 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1272 microversion: 2.1 time: 0.111594 Nov 16 19:09:58.654801 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 424/867] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:58 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:09:59.607485 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-32ebd206-070c-4052-8acc-9b029b58fe2e req-1af112cd-2f83-4268-8ccb-a5c9fe04af41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65541a0-f51b-4626-98f0-29613fe9b588", "tag": "00a4beda-1ea1-4d51-8201-e1d44ef164d0"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:09:59.610021 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:09:59.610021 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:09:59.619971 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-32ebd206-070c-4052-8acc-9b029b58fe2e req-1af112cd-2f83-4268-8ccb-a5c9fe04af41 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:59.620789 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-32ebd206-070c-4052-8acc-9b029b58fe2e req-1af112cd-2f83-4268-8ccb-a5c9fe04af41 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:59.634799 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-32ebd206-070c-4052-8acc-9b029b58fe2e req-1af112cd-2f83-4268-8ccb-a5c9fe04af41 service nova] Creating event network-changed:00a4beda-1ea1-4d51-8201-e1d44ef164d0 for instance a65541a0-f51b-4626-98f0-29613fe9b588 on hv-cinder-66710 Nov 16 19:09:59.646853 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-32ebd206-070c-4052-8acc-9b029b58fe2e req-1af112cd-2f83-4268-8ccb-a5c9fe04af41 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044206 Nov 16 19:09:59.647512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 444/868] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:09:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:09:59.671355 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c7361c2b-9226-49b3-8716-08c76c0a2ab9 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:09:59.671960 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c7361c2b-9226-49b3-8716-08c76c0a2ab9 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:09:59.678205 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7361c2b-9226-49b3-8716-08c76c0a2ab9 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:59.678884 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7361c2b-9226-49b3-8716-08c76c0a2ab9 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:59.679663 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7361c2b-9226-49b3-8716-08c76c0a2ab9 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:09:59.680091 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c7361c2b-9226-49b3-8716-08c76c0a2ab9 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:09:59.935582 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c7361c2b-9226-49b3-8716-08c76c0a2ab9 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:09:59.943183 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c7361c2b-9226-49b3-8716-08c76c0a2ab9 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1314 microversion: 2.1 time: 0.275483 Nov 16 19:09:59.944011 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 425/869] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:09:59 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:00.960730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a2dcb485-c45c-493c-8a90-b3c4ba726108 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:00.961463 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a2dcb485-c45c-493c-8a90-b3c4ba726108 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:00.967964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a2dcb485-c45c-493c-8a90-b3c4ba726108 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:00.968550 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a2dcb485-c45c-493c-8a90-b3c4ba726108 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:00.969665 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a2dcb485-c45c-493c-8a90-b3c4ba726108 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:00.970681 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a2dcb485-c45c-493c-8a90-b3c4ba726108 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:01.199578 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a2dcb485-c45c-493c-8a90-b3c4ba726108 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:01.207707 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a2dcb485-c45c-493c-8a90-b3c4ba726108 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1314 microversion: 2.1 time: 0.251162 Nov 16 19:10:01.208472 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 445/870] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:00 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:02.224273 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5a76521f-f89d-49c8-95b2-b0ab32e048af tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:02.224964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5a76521f-f89d-49c8-95b2-b0ab32e048af tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:02.231402 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5a76521f-f89d-49c8-95b2-b0ab32e048af tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:02.231854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5a76521f-f89d-49c8-95b2-b0ab32e048af tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:02.232651 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5a76521f-f89d-49c8-95b2-b0ab32e048af tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:02.233088 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5a76521f-f89d-49c8-95b2-b0ab32e048af tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:02.403405 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5a76521f-f89d-49c8-95b2-b0ab32e048af tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:02.412425 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5a76521f-f89d-49c8-95b2-b0ab32e048af tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1314 microversion: 2.1 time: 0.191994 Nov 16 19:10:02.413011 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 426/871] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:02 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:03.430361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f4a67db9-a47e-4ee3-9b99-f7cc53dfd048 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:03.431199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f4a67db9-a47e-4ee3-9b99-f7cc53dfd048 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:03.437530 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f4a67db9-a47e-4ee3-9b99-f7cc53dfd048 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:03.438004 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f4a67db9-a47e-4ee3-9b99-f7cc53dfd048 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:03.439409 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f4a67db9-a47e-4ee3-9b99-f7cc53dfd048 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:03.440062 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f4a67db9-a47e-4ee3-9b99-f7cc53dfd048 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:03.685495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f4a67db9-a47e-4ee3-9b99-f7cc53dfd048 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:03.692812 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f4a67db9-a47e-4ee3-9b99-f7cc53dfd048 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1314 microversion: 2.1 time: 0.267376 Nov 16 19:10:03.693378 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 446/872] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:03 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:04.709229 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e8d1185b-2dc9-4684-886c-53621494e16e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:04.709882 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e8d1185b-2dc9-4684-886c-53621494e16e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:04.717454 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e8d1185b-2dc9-4684-886c-53621494e16e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:04.717927 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e8d1185b-2dc9-4684-886c-53621494e16e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:04.719073 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e8d1185b-2dc9-4684-886c-53621494e16e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:04.719511 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e8d1185b-2dc9-4684-886c-53621494e16e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:04.869160 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e8d1185b-2dc9-4684-886c-53621494e16e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:04.877267 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e8d1185b-2dc9-4684-886c-53621494e16e tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1314 microversion: 2.1 time: 0.171520 Nov 16 19:10:04.879388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 427/873] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:04 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:05.895704 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3f454ba2-ee8a-44ec-8512-26050e536715 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:05.896921 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3f454ba2-ee8a-44ec-8512-26050e536715 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:05.907912 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f454ba2-ee8a-44ec-8512-26050e536715 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:05.908364 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f454ba2-ee8a-44ec-8512-26050e536715 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:05.909185 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f454ba2-ee8a-44ec-8512-26050e536715 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:05.909761 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f454ba2-ee8a-44ec-8512-26050e536715 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:06.056034 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3f454ba2-ee8a-44ec-8512-26050e536715 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:06.064390 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3f454ba2-ee8a-44ec-8512-26050e536715 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1314 microversion: 2.1 time: 0.172170 Nov 16 19:10:06.065061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 447/874] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:05 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:10:06.806528 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-8dff0a56-54af-4355-bbcc-6e863210f423 req-d5e775a3-587f-45af-bf0d-d3eb2670cc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65541a0-f51b-4626-98f0-29613fe9b588", "name": "network-vif-plugged", "status": "completed", "tag": "00a4beda-1ea1-4d51-8201-e1d44ef164d0"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:06.808910 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:10:06.808910 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:10:06.818104 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-8dff0a56-54af-4355-bbcc-6e863210f423 req-d5e775a3-587f-45af-bf0d-d3eb2670cc9c service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:06.819498 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-8dff0a56-54af-4355-bbcc-6e863210f423 req-d5e775a3-587f-45af-bf0d-d3eb2670cc9c service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:06.844050 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-8dff0a56-54af-4355-bbcc-6e863210f423 req-d5e775a3-587f-45af-bf0d-d3eb2670cc9c service nova] Creating event network-vif-plugged:00a4beda-1ea1-4d51-8201-e1d44ef164d0 for instance a65541a0-f51b-4626-98f0-29613fe9b588 on hv-cinder-66710 Nov 16 19:10:06.858897 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-8dff0a56-54af-4355-bbcc-6e863210f423 req-d5e775a3-587f-45af-bf0d-d3eb2670cc9c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055630 Nov 16 19:10:06.861096 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 428/875] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:10:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:10:07.082766 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-77cd0253-42f1-4c8a-9126-1899113e04a6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:07.084081 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-77cd0253-42f1-4c8a-9126-1899113e04a6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:07.091468 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77cd0253-42f1-4c8a-9126-1899113e04a6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:07.092248 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77cd0253-42f1-4c8a-9126-1899113e04a6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:07.093250 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77cd0253-42f1-4c8a-9126-1899113e04a6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:07.094035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77cd0253-42f1-4c8a-9126-1899113e04a6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:07.241596 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-77cd0253-42f1-4c8a-9126-1899113e04a6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:07.252657 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-77cd0253-42f1-4c8a-9126-1899113e04a6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1314 microversion: 2.1 time: 0.174939 Nov 16 19:10:07.254506 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 448/876] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:07 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:08.271906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bbeeb6d3-9931-4640-8b53-6d6761555aba tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:08.273431 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bbeeb6d3-9931-4640-8b53-6d6761555aba tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:08.284761 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbeeb6d3-9931-4640-8b53-6d6761555aba tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:08.285126 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbeeb6d3-9931-4640-8b53-6d6761555aba tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:08.285960 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbeeb6d3-9931-4640-8b53-6d6761555aba tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:08.286395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbeeb6d3-9931-4640-8b53-6d6761555aba tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:08.587166 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bbeeb6d3-9931-4640-8b53-6d6761555aba tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:08.594583 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bbeeb6d3-9931-4640-8b53-6d6761555aba tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1314 microversion: 2.1 time: 0.326590 Nov 16 19:10:08.596097 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 429/877] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:08 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:09.611824 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f68910f9-8ce1-45f3-a524-54dd9cf43cc7 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:09.612604 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f68910f9-8ce1-45f3-a524-54dd9cf43cc7 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:09.619425 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f68910f9-8ce1-45f3-a524-54dd9cf43cc7 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:09.620015 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f68910f9-8ce1-45f3-a524-54dd9cf43cc7 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:09.620937 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f68910f9-8ce1-45f3-a524-54dd9cf43cc7 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:09.621475 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f68910f9-8ce1-45f3-a524-54dd9cf43cc7 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:09.914693 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f68910f9-8ce1-45f3-a524-54dd9cf43cc7 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:09.924280 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f68910f9-8ce1-45f3-a524-54dd9cf43cc7 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1497 microversion: 2.1 time: 0.316712 Nov 16 19:10:09.925133 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 449/878] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:09 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1497 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:10.391784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-aadeae28-b913-4780-a27c-95e7b5416da4 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:10.392397 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-aadeae28-b913-4780-a27c-95e7b5416da4 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:10.399120 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aadeae28-b913-4780-a27c-95e7b5416da4 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:10.399807 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aadeae28-b913-4780-a27c-95e7b5416da4 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:10.401153 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aadeae28-b913-4780-a27c-95e7b5416da4 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:10.402051 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-aadeae28-b913-4780-a27c-95e7b5416da4 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:10.442185 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-aadeae28-b913-4780-a27c-95e7b5416da4 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:10:10.540121 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-aadeae28-b913-4780-a27c-95e7b5416da4 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 204 len: 0 microversion: 2.1 time: 0.151819 Nov 16 19:10:10.544712 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 430/879] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:10:10 2021] DELETE /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:10:10.551655 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6f20f006-3eb8-40e1-bf58-bb630ea8e9c1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:10.552246 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6f20f006-3eb8-40e1-bf58-bb630ea8e9c1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:10.562635 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f20f006-3eb8-40e1-bf58-bb630ea8e9c1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:10.563084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f20f006-3eb8-40e1-bf58-bb630ea8e9c1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:10.563943 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f20f006-3eb8-40e1-bf58-bb630ea8e9c1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:10.565653 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f20f006-3eb8-40e1-bf58-bb630ea8e9c1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:10.747350 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6f20f006-3eb8-40e1-bf58-bb630ea8e9c1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:10.755615 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6f20f006-3eb8-40e1-bf58-bb630ea8e9c1 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1503 microversion: 2.1 time: 0.208471 Nov 16 19:10:10.756188 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 450/880] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:10 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:11.774383 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-05985330-8fa5-4b7f-949d-d43fc67e8970 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:11.775067 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-05985330-8fa5-4b7f-949d-d43fc67e8970 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:11.784546 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-05985330-8fa5-4b7f-949d-d43fc67e8970 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:11.785074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-05985330-8fa5-4b7f-949d-d43fc67e8970 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:11.785999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-05985330-8fa5-4b7f-949d-d43fc67e8970 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:11.786502 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-05985330-8fa5-4b7f-949d-d43fc67e8970 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:11.974660 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-05985330-8fa5-4b7f-949d-d43fc67e8970 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:11.982106 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-05985330-8fa5-4b7f-949d-d43fc67e8970 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1503 microversion: 2.1 time: 0.211985 Nov 16 19:10:11.991876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 431/881] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:11 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:12.543324 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-1f52a739-d5f0-444a-9163-5905ecfabd82 req-3ae65f73-9a3f-477a-87b6-ae53be5ac016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65541a0-f51b-4626-98f0-29613fe9b588", "name": "network-vif-deleted", "tag": "00a4beda-1ea1-4d51-8201-e1d44ef164d0"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:12.547324 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:10:12.547324 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:10:12.557392 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-1f52a739-d5f0-444a-9163-5905ecfabd82 req-3ae65f73-9a3f-477a-87b6-ae53be5ac016 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:12.558397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-1f52a739-d5f0-444a-9163-5905ecfabd82 req-3ae65f73-9a3f-477a-87b6-ae53be5ac016 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:12.582083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-1f52a739-d5f0-444a-9163-5905ecfabd82 req-3ae65f73-9a3f-477a-87b6-ae53be5ac016 service nova] Creating event network-vif-deleted:00a4beda-1ea1-4d51-8201-e1d44ef164d0 for instance a65541a0-f51b-4626-98f0-29613fe9b588 on hv-cinder-66710 Nov 16 19:10:12.588078 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-1f52a739-d5f0-444a-9163-5905ecfabd82 req-3ae65f73-9a3f-477a-87b6-ae53be5ac016 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057969 Nov 16 19:10:12.602345 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 451/882] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:10:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:10:13.000195 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:13.002644 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:13.011767 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:13.012476 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:13.013439 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:13.014054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:13.053540 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:13.054254 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:13.054853 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lazy-loading 'fault' on Instance uuid a65541a0-f51b-4626-98f0-29613fe9b588 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:10:13.119207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e887ab0d91d4dd9bc9c189c0c4070c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e543afad06c44fc192c42924e11befdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:13.128854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9dfea3e5-e52a-415a-979b-102511506bb6 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 200 len: 1304 microversion: 2.1 time: 0.133022 Nov 16 19:10:13.137402 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 432/883] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:12 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:14.147057 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:14.147705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] [instance: a65541a0-f51b-4626-98f0-29613fe9b588] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:14.164150 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:14.164845 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:14.165825 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:14.166416 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:14.185753 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] HTTP exception thrown: Instance a65541a0-f51b-4626-98f0-29613fe9b588 could not be found. Nov 16 19:10:14.187086 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] Returning 404 to user: Instance a65541a0-f51b-4626-98f0-29613fe9b588 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:10:14.189139 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-10682548-c37a-41a8-87a7-16b051f0fd64 tempest-VolumesActionsTest-125143146 tempest-VolumesActionsTest-125143146-project] 10.222.0.46 "GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588" status: 404 len: 111 microversion: 2.1 time: 0.046366 Nov 16 19:10:14.191348 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 452/884] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:14 2021] GET /compute/v2.1/servers/a65541a0-f51b-4626-98f0-29613fe9b588 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:10:20.146924 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-16047061-6fde-49a4-90d7-17ebb4f40bf5 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Action: 'create', calling method: .version_select at 0x7ffa56bd2040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1956645032"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:20.163793 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-16047061-6fde-49a4-90d7-17ebb4f40bf5 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Getting quotas for project 0b043ff8fd5b4a328d325072a1c372d8. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:10:20.167708 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-16047061-6fde-49a4-90d7-17ebb4f40bf5 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Getting quotas for user a4f4f6469d4647428471743e0ecbb1b8 and project 0b043ff8fd5b4a328d325072a1c372d8. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:10:20.426647 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-16047061-6fde-49a4-90d7-17ebb4f40bf5 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Getting quotas for project 0b043ff8fd5b4a328d325072a1c372d8. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:10:20.431021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-16047061-6fde-49a4-90d7-17ebb4f40bf5 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Getting quotas for user a4f4f6469d4647428471743e0ecbb1b8 and project 0b043ff8fd5b4a328d325072a1c372d8. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:10:20.445151 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-16047061-6fde-49a4-90d7-17ebb4f40bf5 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.304447 Nov 16 19:10:20.446307 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 433/885] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 19:10:20 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:20.499783 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-594701130", "imageRef": "4547d459-bc11-4e99-8836-5aa68db4f4ed", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1956645032", "networks": [{"uuid": "066ac6d3-663a-44d9-925d-246eb834c887"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:20.560597 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] validate_networks() for [('066ac6d3-663a-44d9-925d-246eb834c887', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:10:21.089562 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:10:21.090007 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:10:21.090482 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:10:21.090964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:10:21.091375 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:10:21.100969 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:21.101414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:21.102260 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:21.102699 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:21.120228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Getting quotas for project 0b043ff8fd5b4a328d325072a1c372d8. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:10:21.124338 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Getting quotas for user a4f4f6469d4647428471743e0ecbb1b8 and project 0b043ff8fd5b4a328d325072a1c372d8. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:10:21.136840 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:10:21.139140 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4547d459-bc11-4e99-8836-5aa68db4f4ed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:10:21.191353 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-51c129dd-6fef-422a-9a4e-a57e3530429e tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695498 Nov 16 19:10:21.197013 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 453/886] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:10:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:10:21.202619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f73c0888-e633-45e3-a3f3-d44504cd0895 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:21.203157 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f73c0888-e633-45e3-a3f3-d44504cd0895 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:21.272894 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f73c0888-e633-45e3-a3f3-d44504cd0895 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:21.287437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f73c0888-e633-45e3-a3f3-d44504cd0895 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1258 microversion: 2.1 time: 0.088839 Nov 16 19:10:21.299496 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 434/887] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:21 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1258 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:22.306976 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-60d6836d-668a-4844-aa7d-1c65b98e47b1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:22.310040 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-60d6836d-668a-4844-aa7d-1c65b98e47b1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:22.318125 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60d6836d-668a-4844-aa7d-1c65b98e47b1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:22.318865 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60d6836d-668a-4844-aa7d-1c65b98e47b1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:22.320084 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60d6836d-668a-4844-aa7d-1c65b98e47b1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:22.320687 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60d6836d-668a-4844-aa7d-1c65b98e47b1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:22.400374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-60d6836d-668a-4844-aa7d-1c65b98e47b1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:22.409590 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-60d6836d-668a-4844-aa7d-1c65b98e47b1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1328 microversion: 2.1 time: 0.106831 Nov 16 19:10:22.410171 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 454/888] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:22 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:23.429736 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cbfed98a-0679-4389-8bda-3fd4ae6f0f0c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:23.431294 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cbfed98a-0679-4389-8bda-3fd4ae6f0f0c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:23.453780 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbfed98a-0679-4389-8bda-3fd4ae6f0f0c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:23.454300 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbfed98a-0679-4389-8bda-3fd4ae6f0f0c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:23.455087 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbfed98a-0679-4389-8bda-3fd4ae6f0f0c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:23.455526 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cbfed98a-0679-4389-8bda-3fd4ae6f0f0c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:23.673193 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cbfed98a-0679-4389-8bda-3fd4ae6f0f0c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:23.685291 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cbfed98a-0679-4389-8bda-3fd4ae6f0f0c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.260363 Nov 16 19:10:23.686229 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 435/889] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:23 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:24.707358 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-74ceb00d-e56f-4532-908a-5f6e985c72d9 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:24.708849 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-74ceb00d-e56f-4532-908a-5f6e985c72d9 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:24.720336 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-74ceb00d-e56f-4532-908a-5f6e985c72d9 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:24.721060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-74ceb00d-e56f-4532-908a-5f6e985c72d9 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:24.721871 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-74ceb00d-e56f-4532-908a-5f6e985c72d9 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:24.722481 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-74ceb00d-e56f-4532-908a-5f6e985c72d9 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:24.932493 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-74ceb00d-e56f-4532-908a-5f6e985c72d9 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:24.941238 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-74ceb00d-e56f-4532-908a-5f6e985c72d9 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.239761 Nov 16 19:10:24.943680 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 455/890] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:24 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:25.962495 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-54fd193e-73ee-4c19-920d-9fdd3f60f2b8 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:25.963171 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-54fd193e-73ee-4c19-920d-9fdd3f60f2b8 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:25.976597 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-54fd193e-73ee-4c19-920d-9fdd3f60f2b8 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:25.977047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-54fd193e-73ee-4c19-920d-9fdd3f60f2b8 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:25.977863 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-54fd193e-73ee-4c19-920d-9fdd3f60f2b8 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:25.978573 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-54fd193e-73ee-4c19-920d-9fdd3f60f2b8 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:26.231976 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-54fd193e-73ee-4c19-920d-9fdd3f60f2b8 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:26.241634 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-54fd193e-73ee-4c19-920d-9fdd3f60f2b8 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.282689 Nov 16 19:10:26.253406 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 436/891] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:25 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:27.260219 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1fa89f28-8a40-4e9f-9001-893bc3ae630c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:27.261695 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1fa89f28-8a40-4e9f-9001-893bc3ae630c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:27.272604 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1fa89f28-8a40-4e9f-9001-893bc3ae630c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:27.273362 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1fa89f28-8a40-4e9f-9001-893bc3ae630c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:27.275764 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1fa89f28-8a40-4e9f-9001-893bc3ae630c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:27.276385 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1fa89f28-8a40-4e9f-9001-893bc3ae630c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:27.487620 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1fa89f28-8a40-4e9f-9001-893bc3ae630c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:27.501237 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1fa89f28-8a40-4e9f-9001-893bc3ae630c tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.243876 Nov 16 19:10:27.506918 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 456/892] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:27 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:10:28.518399 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-679af365-33cb-4f55-aedd-b2466f9b0cd1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:28.519012 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-679af365-33cb-4f55-aedd-b2466f9b0cd1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:28.528631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-679af365-33cb-4f55-aedd-b2466f9b0cd1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:28.529230 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-679af365-33cb-4f55-aedd-b2466f9b0cd1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:28.530330 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-679af365-33cb-4f55-aedd-b2466f9b0cd1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:28.531563 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-679af365-33cb-4f55-aedd-b2466f9b0cd1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:28.762675 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-679af365-33cb-4f55-aedd-b2466f9b0cd1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:28.780721 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-679af365-33cb-4f55-aedd-b2466f9b0cd1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.266374 Nov 16 19:10:28.782084 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 437/893] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:28 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:29.799367 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8eaf47e8-9b85-458b-9598-80c657acff1a tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:29.800259 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8eaf47e8-9b85-458b-9598-80c657acff1a tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:29.814729 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8eaf47e8-9b85-458b-9598-80c657acff1a tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:29.815338 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8eaf47e8-9b85-458b-9598-80c657acff1a tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:29.816398 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8eaf47e8-9b85-458b-9598-80c657acff1a tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:29.817051 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8eaf47e8-9b85-458b-9598-80c657acff1a tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:30.035969 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8eaf47e8-9b85-458b-9598-80c657acff1a tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:30.045058 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8eaf47e8-9b85-458b-9598-80c657acff1a tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.250097 Nov 16 19:10:30.046325 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 457/894] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:29 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:31.062416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-23b8a585-5c91-4ed9-aec9-6a78db120bc0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:31.063056 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-23b8a585-5c91-4ed9-aec9-6a78db120bc0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:31.068954 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-23b8a585-5c91-4ed9-aec9-6a78db120bc0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:31.069405 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-23b8a585-5c91-4ed9-aec9-6a78db120bc0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:31.070226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-23b8a585-5c91-4ed9-aec9-6a78db120bc0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:31.070758 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-23b8a585-5c91-4ed9-aec9-6a78db120bc0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:31.226420 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-23b8a585-5c91-4ed9-aec9-6a78db120bc0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:31.247016 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-23b8a585-5c91-4ed9-aec9-6a78db120bc0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.188315 Nov 16 19:10:31.247991 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 438/895] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:31 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:32.266638 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-40460ac9-81b4-47d5-b7ce-08bf52797c51 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:32.267279 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-40460ac9-81b4-47d5-b7ce-08bf52797c51 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:32.274671 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40460ac9-81b4-47d5-b7ce-08bf52797c51 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:32.275157 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40460ac9-81b4-47d5-b7ce-08bf52797c51 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:32.275969 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40460ac9-81b4-47d5-b7ce-08bf52797c51 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:32.276400 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40460ac9-81b4-47d5-b7ce-08bf52797c51 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:32.423295 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-40460ac9-81b4-47d5-b7ce-08bf52797c51 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:32.430718 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-40460ac9-81b4-47d5-b7ce-08bf52797c51 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.167782 Nov 16 19:10:32.431286 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 458/896] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:32 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:33.450131 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-81aaf0ed-86e1-4a4e-b156-4b951ce2540d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:33.451421 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-81aaf0ed-86e1-4a4e-b156-4b951ce2540d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:33.461847 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-81aaf0ed-86e1-4a4e-b156-4b951ce2540d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:33.462578 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-81aaf0ed-86e1-4a4e-b156-4b951ce2540d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:33.464962 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-81aaf0ed-86e1-4a4e-b156-4b951ce2540d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:33.466241 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-81aaf0ed-86e1-4a4e-b156-4b951ce2540d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:33.484671 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-540a49a0-3078-4eaf-9c14-7551211ce146 req-6bb4ffa0-9bab-4e79-a807-d6cd3ba92b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb255369-3900-4aea-a2e5-a1fb5374763c", "tag": "64bb2f75-c646-411c-a0ed-f1eff8a865b6"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:33.486913 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:10:33.486913 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:10:33.507061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-540a49a0-3078-4eaf-9c14-7551211ce146 req-6bb4ffa0-9bab-4e79-a807-d6cd3ba92b02 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:33.511424 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-540a49a0-3078-4eaf-9c14-7551211ce146 req-6bb4ffa0-9bab-4e79-a807-d6cd3ba92b02 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:33.537583 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-540a49a0-3078-4eaf-9c14-7551211ce146 req-6bb4ffa0-9bab-4e79-a807-d6cd3ba92b02 service nova] Creating event network-changed:64bb2f75-c646-411c-a0ed-f1eff8a865b6 for instance bb255369-3900-4aea-a2e5-a1fb5374763c on hv-cinder-66710 Nov 16 19:10:33.542690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-540a49a0-3078-4eaf-9c14-7551211ce146 req-6bb4ffa0-9bab-4e79-a807-d6cd3ba92b02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062762 Nov 16 19:10:33.544632 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 459/897] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:10:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:10:33.799179 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-81aaf0ed-86e1-4a4e-b156-4b951ce2540d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:33.807227 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-81aaf0ed-86e1-4a4e-b156-4b951ce2540d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.360655 Nov 16 19:10:33.807804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 439/898] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:33 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:34.825700 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6ce9f5ab-6c1b-4dc0-bc86-b75ffbefe2e6 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:34.826304 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6ce9f5ab-6c1b-4dc0-bc86-b75ffbefe2e6 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:34.833193 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6ce9f5ab-6c1b-4dc0-bc86-b75ffbefe2e6 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:34.833674 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6ce9f5ab-6c1b-4dc0-bc86-b75ffbefe2e6 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:34.834451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6ce9f5ab-6c1b-4dc0-bc86-b75ffbefe2e6 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:34.834885 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6ce9f5ab-6c1b-4dc0-bc86-b75ffbefe2e6 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:34.962450 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6ce9f5ab-6c1b-4dc0-bc86-b75ffbefe2e6 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:34.970392 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6ce9f5ab-6c1b-4dc0-bc86-b75ffbefe2e6 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.148810 Nov 16 19:10:34.970991 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 460/899] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:34 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:35.987852 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bdf87db0-9623-44ef-a467-5efa0c4717a4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:35.988449 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bdf87db0-9623-44ef-a467-5efa0c4717a4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:35.994634 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bdf87db0-9623-44ef-a467-5efa0c4717a4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:35.995079 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bdf87db0-9623-44ef-a467-5efa0c4717a4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:35.995839 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bdf87db0-9623-44ef-a467-5efa0c4717a4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:35.996267 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bdf87db0-9623-44ef-a467-5efa0c4717a4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:36.120784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bdf87db0-9623-44ef-a467-5efa0c4717a4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:36.128193 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bdf87db0-9623-44ef-a467-5efa0c4717a4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.144649 Nov 16 19:10:36.128753 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 440/900] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:35 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:37.144784 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3a0e343f-c8da-4bca-8b34-6be42a3171f2 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:37.145341 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3a0e343f-c8da-4bca-8b34-6be42a3171f2 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:37.151801 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a0e343f-c8da-4bca-8b34-6be42a3171f2 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:37.152258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a0e343f-c8da-4bca-8b34-6be42a3171f2 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:37.153039 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a0e343f-c8da-4bca-8b34-6be42a3171f2 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:37.153467 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a0e343f-c8da-4bca-8b34-6be42a3171f2 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:37.295652 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3a0e343f-c8da-4bca-8b34-6be42a3171f2 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:37.303316 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3a0e343f-c8da-4bca-8b34-6be42a3171f2 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.162776 Nov 16 19:10:37.305640 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 461/901] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:37 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:38.320081 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-181698bf-af4f-41b3-96c9-6efa5476f693 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:38.320675 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-181698bf-af4f-41b3-96c9-6efa5476f693 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:38.327034 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-181698bf-af4f-41b3-96c9-6efa5476f693 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:38.327530 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-181698bf-af4f-41b3-96c9-6efa5476f693 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:38.328423 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-181698bf-af4f-41b3-96c9-6efa5476f693 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:38.328857 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-181698bf-af4f-41b3-96c9-6efa5476f693 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:38.471019 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-181698bf-af4f-41b3-96c9-6efa5476f693 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:38.478935 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-181698bf-af4f-41b3-96c9-6efa5476f693 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.162429 Nov 16 19:10:38.479501 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 441/902] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:38 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:38.604320 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-b08869ca-a166-469d-afdb-8209a470531f req-918b6a8c-54ea-4a02-8929-d440b449794a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb255369-3900-4aea-a2e5-a1fb5374763c", "name": "network-vif-plugged", "status": "completed", "tag": "64bb2f75-c646-411c-a0ed-f1eff8a865b6"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:38.605841 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:10:38.605841 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:10:38.613874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-b08869ca-a166-469d-afdb-8209a470531f req-918b6a8c-54ea-4a02-8929-d440b449794a service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:38.614296 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-b08869ca-a166-469d-afdb-8209a470531f req-918b6a8c-54ea-4a02-8929-d440b449794a service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:38.626349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-b08869ca-a166-469d-afdb-8209a470531f req-918b6a8c-54ea-4a02-8929-d440b449794a service nova] Creating event network-vif-plugged:64bb2f75-c646-411c-a0ed-f1eff8a865b6 for instance bb255369-3900-4aea-a2e5-a1fb5374763c on hv-cinder-66710 Nov 16 19:10:38.631427 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-b08869ca-a166-469d-afdb-8209a470531f req-918b6a8c-54ea-4a02-8929-d440b449794a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031090 Nov 16 19:10:38.632379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 462/903] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:10:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:10:39.495929 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-01463bd8-f97d-4840-a12f-97172f060466 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:39.496559 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-01463bd8-f97d-4840-a12f-97172f060466 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:39.503514 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01463bd8-f97d-4840-a12f-97172f060466 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:39.503949 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01463bd8-f97d-4840-a12f-97172f060466 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:39.504816 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01463bd8-f97d-4840-a12f-97172f060466 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:39.505277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-01463bd8-f97d-4840-a12f-97172f060466 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:39.701713 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-01463bd8-f97d-4840-a12f-97172f060466 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:39.710384 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-01463bd8-f97d-4840-a12f-97172f060466 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1358 microversion: 2.1 time: 0.217955 Nov 16 19:10:39.711109 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 442/904] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:39 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:40.729373 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-db999812-e626-4ce2-b17a-0be5b7448730 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:40.730397 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-db999812-e626-4ce2-b17a-0be5b7448730 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:40.737793 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db999812-e626-4ce2-b17a-0be5b7448730 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:40.738277 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db999812-e626-4ce2-b17a-0be5b7448730 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:40.739372 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db999812-e626-4ce2-b17a-0be5b7448730 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:40.739909 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db999812-e626-4ce2-b17a-0be5b7448730 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:40.889001 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-db999812-e626-4ce2-b17a-0be5b7448730 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:40.897603 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-db999812-e626-4ce2-b17a-0be5b7448730 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1548 microversion: 2.1 time: 0.172782 Nov 16 19:10:40.909975 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 463/905] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:40 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:40.916025 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8eb6a1e8-30b1-4bc0-9996-ae5a2d68a13d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:40.917228 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8eb6a1e8-30b1-4bc0-9996-ae5a2d68a13d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:40.924114 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8eb6a1e8-30b1-4bc0-9996-ae5a2d68a13d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:40.924780 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8eb6a1e8-30b1-4bc0-9996-ae5a2d68a13d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:40.925758 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8eb6a1e8-30b1-4bc0-9996-ae5a2d68a13d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:40.926347 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8eb6a1e8-30b1-4bc0-9996-ae5a2d68a13d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:41.162198 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-8eb6a1e8-30b1-4bc0-9996-ae5a2d68a13d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:41.169627 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8eb6a1e8-30b1-4bc0-9996-ae5a2d68a13d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1548 microversion: 2.1 time: 0.257766 Nov 16 19:10:41.170945 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 443/906] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:40 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1548 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:41.187695 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:41.191404 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:10:41.191404 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:10:41.192763 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:41.193820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Searching by: {'deleted': False, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8'} {{(pid=116168) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 16 19:10:41.200555 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:41.200992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:41.202311 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:41.203361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:41.300948 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.multi_cell_list [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116168) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 16 19:10:41.400799 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7dbf49bd-1560-409b-8349-655375216640 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.217265 Nov 16 19:10:41.402100 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 464/907] 10.222.0.46 () {58 vars in 1124 bytes} [Tue Nov 16 19:10:41 2021] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:10:41.412994 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cb24e0fa-088b-4093-a7a9-5c20a177e26d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:41.416459 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cb24e0fa-088b-4093-a7a9-5c20a177e26d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:41.423300 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb24e0fa-088b-4093-a7a9-5c20a177e26d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:41.424192 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb24e0fa-088b-4093-a7a9-5c20a177e26d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:41.425165 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb24e0fa-088b-4093-a7a9-5c20a177e26d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:41.425824 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb24e0fa-088b-4093-a7a9-5c20a177e26d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:41.731627 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cb24e0fa-088b-4093-a7a9-5c20a177e26d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:41.740287 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cb24e0fa-088b-4093-a7a9-5c20a177e26d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1548 microversion: 2.1 time: 0.330978 Nov 16 19:10:41.741014 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 444/908] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:41 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1548 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:43.300173 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9a5bb41d-36aa-4f92-92a7-03ecd44ac2d1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e544422f-d8d2-4520-84ad-1985742d0ee8"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:43.301119 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9a5bb41d-36aa-4f92-92a7-03ecd44ac2d1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:43.307513 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a5bb41d-36aa-4f92-92a7-03ecd44ac2d1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:43.307955 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a5bb41d-36aa-4f92-92a7-03ecd44ac2d1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:43.308765 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a5bb41d-36aa-4f92-92a7-03ecd44ac2d1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:43.309389 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a5bb41d-36aa-4f92-92a7-03ecd44ac2d1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:43.572880 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9a5bb41d-36aa-4f92-92a7-03ecd44ac2d1 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "POST /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276161 Nov 16 19:10:43.573482 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 465/909] 10.222.0.46 () {60 vars in 1322 bytes} [Tue Nov 16 19:10:43 2021] POST /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:10:48.004079 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-773dc23b-5826-4e57-85af-a540d2bda8e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Action: 'create', calling method: .version_select at 0x7ffa56bbf1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-376292854"}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:48.018067 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-773dc23b-5826-4e57-85af-a540d2bda8e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for project ffaa0849f50740c491e5f247362c3b10. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:10:48.022027 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-773dc23b-5826-4e57-85af-a540d2bda8e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for user 99e8dcf6fbda47a0b243239f62720c4a and project ffaa0849f50740c491e5f247362c3b10. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:10:48.100124 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-773dc23b-5826-4e57-85af-a540d2bda8e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for project ffaa0849f50740c491e5f247362c3b10. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:10:48.104009 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-773dc23b-5826-4e57-85af-a540d2bda8e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for user 99e8dcf6fbda47a0b243239f62720c4a and project ffaa0849f50740c491e5f247362c3b10. Resources: {'key_pairs'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:10:48.117783 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-773dc23b-5826-4e57-85af-a540d2bda8e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.278289 Nov 16 19:10:48.118359 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 445/910] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 19:10:47 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:50.094044 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-51e426ff-f18f-42d6-87c8-a3fc9201082b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:50.094738 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-51e426ff-f18f-42d6-87c8-a3fc9201082b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:50.100990 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51e426ff-f18f-42d6-87c8-a3fc9201082b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:50.101426 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51e426ff-f18f-42d6-87c8-a3fc9201082b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:50.102228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51e426ff-f18f-42d6-87c8-a3fc9201082b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:50.102654 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51e426ff-f18f-42d6-87c8-a3fc9201082b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:50.238240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-51e426ff-f18f-42d6-87c8-a3fc9201082b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:50.245986 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-51e426ff-f18f-42d6-87c8-a3fc9201082b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1594 microversion: 2.1 time: 0.156965 Nov 16 19:10:50.246686 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 466/911] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:50 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:10:52.239245 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-dd2248e9-d346-4728-b188-51e3b914be7b req-d0f37c55-a237-4ada-921d-fa67e3cf878b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb255369-3900-4aea-a2e5-a1fb5374763c", "tag": "64bb2f75-c646-411c-a0ed-f1eff8a865b6"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:52.240887 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:10:52.240887 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:10:52.253143 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-dd2248e9-d346-4728-b188-51e3b914be7b req-d0f37c55-a237-4ada-921d-fa67e3cf878b service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:52.253616 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-dd2248e9-d346-4728-b188-51e3b914be7b req-d0f37c55-a237-4ada-921d-fa67e3cf878b service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:52.265276 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-dd2248e9-d346-4728-b188-51e3b914be7b req-d0f37c55-a237-4ada-921d-fa67e3cf878b service nova] Creating event network-changed:64bb2f75-c646-411c-a0ed-f1eff8a865b6 for instance bb255369-3900-4aea-a2e5-a1fb5374763c on hv-cinder-66710 Nov 16 19:10:52.271965 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-dd2248e9-d346-4728-b188-51e3b914be7b req-d0f37c55-a237-4ada-921d-fa67e3cf878b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103158 Nov 16 19:10:52.273022 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 446/912] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:10:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:10:53.288074 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cef780d0-8da4-4e25-ab90-64b93181363d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-96818900"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:53.288648 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cef780d0-8da4-4e25-ab90-64b93181363d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:53.294795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cef780d0-8da4-4e25-ab90-64b93181363d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:53.295245 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cef780d0-8da4-4e25-ab90-64b93181363d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:53.296219 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cef780d0-8da4-4e25-ab90-64b93181363d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:53.296652 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cef780d0-8da4-4e25-ab90-64b93181363d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:53.589904 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.network.security_group_api [None req-cef780d0-8da4-4e25-ab90-64b93181363d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Adding security group 079795f4-4566-4d09-9384-e04e622afcb4 to port 64bb2f75-c646-411c-a0ed-f1eff8a865b6 Nov 16 19:10:54.190486 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cef780d0-8da4-4e25-ab90-64b93181363d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "POST /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/action" status: 202 len: 0 microversion: 2.1 time: 0.906587 Nov 16 19:10:54.191768 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 467/913] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:10:53 2021] POST /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:10:54.207243 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-980f83d0-4a31-46b9-a9e4-f7ae268e9ad7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:10:54.208096 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-980f83d0-4a31-46b9-a9e4-f7ae268e9ad7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:10:54.215734 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-980f83d0-4a31-46b9-a9e4-f7ae268e9ad7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:54.216767 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-980f83d0-4a31-46b9-a9e4-f7ae268e9ad7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:54.217685 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-980f83d0-4a31-46b9-a9e4-f7ae268e9ad7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:54.218228 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-980f83d0-4a31-46b9-a9e4-f7ae268e9ad7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:54.289963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-1e2d9f7a-3a36-4b7b-9d5e-1eefbbcd70ee req-21f6f4c4-5c4f-4ee7-b426-a62aef3318f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb255369-3900-4aea-a2e5-a1fb5374763c", "tag": "64bb2f75-c646-411c-a0ed-f1eff8a865b6"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:10:54.291560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:10:54.291560 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:10:54.305593 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-1e2d9f7a-3a36-4b7b-9d5e-1eefbbcd70ee req-21f6f4c4-5c4f-4ee7-b426-a62aef3318f1 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:10:54.306048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-1e2d9f7a-3a36-4b7b-9d5e-1eefbbcd70ee req-21f6f4c4-5c4f-4ee7-b426-a62aef3318f1 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:10:54.319641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-1e2d9f7a-3a36-4b7b-9d5e-1eefbbcd70ee req-21f6f4c4-5c4f-4ee7-b426-a62aef3318f1 service nova] Creating event network-changed:64bb2f75-c646-411c-a0ed-f1eff8a865b6 for instance bb255369-3900-4aea-a2e5-a1fb5374763c on hv-cinder-66710 Nov 16 19:10:54.328581 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-1e2d9f7a-3a36-4b7b-9d5e-1eefbbcd70ee req-21f6f4c4-5c4f-4ee7-b426-a62aef3318f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041067 Nov 16 19:10:54.329730 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 468/914] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:10:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:10:54.462342 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-980f83d0-4a31-46b9-a9e4-f7ae268e9ad7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:10:54.471207 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-980f83d0-4a31-46b9-a9e4-f7ae268e9ad7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1757 microversion: 2.1 time: 0.274206 Nov 16 19:10:54.471991 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 447/915] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:10:54 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1757 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:06.444117 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-657153916", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-376292854", "security_groups": [{"name": "tempest-secgroup-smoke-470136781"}], "block_device_mapping_v2": [{"uuid": "9ebc6643-a8b8-4410-a72a-29fb302b6b47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8869448c-a462-4b3c-b5fc-a38ebbecc48e"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:11:06.551356 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] validate_networks() for [('8869448c-a462-4b3c-b5fc-a38ebbecc48e', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:11:06.919050 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:11:06.919578 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:11:06.920046 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:11:06.920451 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:11:06.921532 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:11:06.930214 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:06.930701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:06.931523 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:06.931954 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:06.947713 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for project ffaa0849f50740c491e5f247362c3b10. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:11:06.951627 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for user 99e8dcf6fbda47a0b243239f62720c4a and project ffaa0849f50740c491e5f247362c3b10. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:11:07.005955 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:11:07.008248 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ebc6643-a8b8-4410-a72a-29fb302b6b47',volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:11:07.128453 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3d11c3d0-cf59-4c96-b922-db3dc6c31f28 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688660 Nov 16 19:11:07.129135 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 469/916] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:11:06 2021] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:11:07.138711 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-167f8fea-3d32-48b4-9c21-5208985882de tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:07.139307 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-167f8fea-3d32-48b4-9c21-5208985882de tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:07.189897 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-167f8fea-3d32-48b4-9c21-5208985882de tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:07.196162 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-167f8fea-3d32-48b4-9c21-5208985882de tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1093 microversion: 2.1 time: 0.061065 Nov 16 19:11:07.196718 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 448/917] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:07 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1093 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:08.213811 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-24bdb426-1b51-4ec0-8f18-55c7895a89bc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:08.214426 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-24bdb426-1b51-4ec0-8f18-55c7895a89bc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:08.221430 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24bdb426-1b51-4ec0-8f18-55c7895a89bc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:08.221922 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24bdb426-1b51-4ec0-8f18-55c7895a89bc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:08.222707 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24bdb426-1b51-4ec0-8f18-55c7895a89bc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:08.223141 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24bdb426-1b51-4ec0-8f18-55c7895a89bc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:08.282016 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-24bdb426-1b51-4ec0-8f18-55c7895a89bc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:08.289306 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-24bdb426-1b51-4ec0-8f18-55c7895a89bc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1209 microversion: 2.1 time: 0.079387 Nov 16 19:11:08.290120 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 470/918] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:08 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:09.307985 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-81466842-ea5f-4f4f-9aac-b519390da6a2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:09.308604 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-81466842-ea5f-4f4f-9aac-b519390da6a2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:09.315503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-81466842-ea5f-4f4f-9aac-b519390da6a2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:09.315948 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-81466842-ea5f-4f4f-9aac-b519390da6a2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:09.316714 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-81466842-ea5f-4f4f-9aac-b519390da6a2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:09.317330 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-81466842-ea5f-4f4f-9aac-b519390da6a2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:09.337357 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-6b16fa11-3e88-4298-a514-d7eb8bacb3a0 req-dd8dcc74-bf3d-4798-9cbc-7bfac246c012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cebd59d-87d0-453a-a5de-0af744f39fa4", "tag": "f1ba6b6f-e867-475e-951d-89b162884955"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:11:09.338822 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:11:09.338822 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:11:09.355835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-6b16fa11-3e88-4298-a514-d7eb8bacb3a0 req-dd8dcc74-bf3d-4798-9cbc-7bfac246c012 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:09.356433 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-6b16fa11-3e88-4298-a514-d7eb8bacb3a0 req-dd8dcc74-bf3d-4798-9cbc-7bfac246c012 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:09.375973 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-6b16fa11-3e88-4298-a514-d7eb8bacb3a0 req-dd8dcc74-bf3d-4798-9cbc-7bfac246c012 service nova] Creating event network-changed:f1ba6b6f-e867-475e-951d-89b162884955 for instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 on hv-cinder-66710 Nov 16 19:11:09.381145 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-6b16fa11-3e88-4298-a514-d7eb8bacb3a0 req-dd8dcc74-bf3d-4798-9cbc-7bfac246c012 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048114 Nov 16 19:11:09.383213 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 471/919] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:11:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:11:09.805896 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-81466842-ea5f-4f4f-9aac-b519390da6a2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:09.814529 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-81466842-ea5f-4f4f-9aac-b519390da6a2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.510198 Nov 16 19:11:09.815101 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 449/920] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:09 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:10.832600 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ff11d4e3-11f5-4daf-a152-b9b3aef5829b tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:10.833234 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ff11d4e3-11f5-4daf-a152-b9b3aef5829b tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:10.839255 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff11d4e3-11f5-4daf-a152-b9b3aef5829b tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:10.839694 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff11d4e3-11f5-4daf-a152-b9b3aef5829b tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:10.840452 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff11d4e3-11f5-4daf-a152-b9b3aef5829b tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:10.840877 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff11d4e3-11f5-4daf-a152-b9b3aef5829b tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:10.971219 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ff11d4e3-11f5-4daf-a152-b9b3aef5829b tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:10.978414 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ff11d4e3-11f5-4daf-a152-b9b3aef5829b tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.150335 Nov 16 19:11:10.978973 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 472/921] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:10 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:11.995047 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-417ad376-52a2-4a84-a803-85e095872146 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:11.995630 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-417ad376-52a2-4a84-a803-85e095872146 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:12.002194 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-417ad376-52a2-4a84-a803-85e095872146 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:12.002638 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-417ad376-52a2-4a84-a803-85e095872146 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:12.003400 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-417ad376-52a2-4a84-a803-85e095872146 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:12.003837 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-417ad376-52a2-4a84-a803-85e095872146 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:12.133941 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-417ad376-52a2-4a84-a803-85e095872146 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:12.141190 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-417ad376-52a2-4a84-a803-85e095872146 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.149856 Nov 16 19:11:12.141774 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 450/922] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:11 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:13.158271 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f64041f7-5555-4982-adf7-8d88e7cd960d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:13.158902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f64041f7-5555-4982-adf7-8d88e7cd960d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:13.165265 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f64041f7-5555-4982-adf7-8d88e7cd960d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:13.165751 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f64041f7-5555-4982-adf7-8d88e7cd960d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:13.166527 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f64041f7-5555-4982-adf7-8d88e7cd960d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:13.166963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f64041f7-5555-4982-adf7-8d88e7cd960d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:13.299052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f64041f7-5555-4982-adf7-8d88e7cd960d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:13.306297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f64041f7-5555-4982-adf7-8d88e7cd960d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.152331 Nov 16 19:11:13.306856 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 473/923] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:13 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:14.323153 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e273df94-65f5-4eba-94cd-c6f2bb88905f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:14.323679 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e273df94-65f5-4eba-94cd-c6f2bb88905f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:14.330835 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e273df94-65f5-4eba-94cd-c6f2bb88905f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:14.331281 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e273df94-65f5-4eba-94cd-c6f2bb88905f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:14.332059 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e273df94-65f5-4eba-94cd-c6f2bb88905f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:14.332491 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e273df94-65f5-4eba-94cd-c6f2bb88905f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:14.464964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e273df94-65f5-4eba-94cd-c6f2bb88905f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:14.477657 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e273df94-65f5-4eba-94cd-c6f2bb88905f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.158205 Nov 16 19:11:14.478245 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 451/924] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:14 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:15.494314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c2b40d0a-0cb5-42f1-aac5-dca20f698913 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:15.494919 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c2b40d0a-0cb5-42f1-aac5-dca20f698913 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:15.501457 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2b40d0a-0cb5-42f1-aac5-dca20f698913 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:15.501940 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2b40d0a-0cb5-42f1-aac5-dca20f698913 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:15.502721 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2b40d0a-0cb5-42f1-aac5-dca20f698913 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:15.503141 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2b40d0a-0cb5-42f1-aac5-dca20f698913 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:15.632409 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c2b40d0a-0cb5-42f1-aac5-dca20f698913 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:15.639559 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c2b40d0a-0cb5-42f1-aac5-dca20f698913 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.148969 Nov 16 19:11:15.640117 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 474/925] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:15 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:16.656001 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-dd750e49-2727-4906-8197-ff42f4d10d8d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:16.656599 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-dd750e49-2727-4906-8197-ff42f4d10d8d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:16.662822 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-dd750e49-2727-4906-8197-ff42f4d10d8d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:16.663263 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-dd750e49-2727-4906-8197-ff42f4d10d8d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:16.664021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-dd750e49-2727-4906-8197-ff42f4d10d8d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:16.664446 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-dd750e49-2727-4906-8197-ff42f4d10d8d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:16.792454 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-dd750e49-2727-4906-8197-ff42f4d10d8d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:16.801022 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-dd750e49-2727-4906-8197-ff42f4d10d8d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.148684 Nov 16 19:11:16.801590 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 452/926] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:16 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:17.817724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2f3b7c63-1191-4853-a69c-534ce71b0854 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:17.818308 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2f3b7c63-1191-4853-a69c-534ce71b0854 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:17.824487 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f3b7c63-1191-4853-a69c-534ce71b0854 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:17.824930 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f3b7c63-1191-4853-a69c-534ce71b0854 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:17.825714 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f3b7c63-1191-4853-a69c-534ce71b0854 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:17.826143 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f3b7c63-1191-4853-a69c-534ce71b0854 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:17.952496 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2f3b7c63-1191-4853-a69c-534ce71b0854 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:17.959678 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2f3b7c63-1191-4853-a69c-534ce71b0854 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.145554 Nov 16 19:11:17.960218 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 475/927] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:17 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:18.976038 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bc199e2f-3776-4979-a5c0-a93cb3aa1294 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:18.976566 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bc199e2f-3776-4979-a5c0-a93cb3aa1294 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:18.983072 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc199e2f-3776-4979-a5c0-a93cb3aa1294 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:18.983516 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc199e2f-3776-4979-a5c0-a93cb3aa1294 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:18.984283 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc199e2f-3776-4979-a5c0-a93cb3aa1294 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:18.984710 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bc199e2f-3776-4979-a5c0-a93cb3aa1294 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:19.110108 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e0218108-14b7-495b-8a22-1550ee38db66 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:11:19.111027 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e0218108-14b7-495b-8a22-1550ee38db66 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:19.117531 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0218108-14b7-495b-8a22-1550ee38db66 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:19.118007 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0218108-14b7-495b-8a22-1550ee38db66 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:19.118795 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0218108-14b7-495b-8a22-1550ee38db66 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:19.119235 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0218108-14b7-495b-8a22-1550ee38db66 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:19.131780 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bc199e2f-3776-4979-a5c0-a93cb3aa1294 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:19.141107 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bc199e2f-3776-4979-a5c0-a93cb3aa1294 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.168698 Nov 16 19:11:19.141926 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 453/928] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:18 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:11:19.194413 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e0218108-14b7-495b-8a22-1550ee38db66 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "POST /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/action" status: 202 len: 0 microversion: 2.1 time: 0.088316 Nov 16 19:11:19.198611 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 476/929] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:11:19 2021] POST /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:11:19.204174 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-57af35ac-4197-4321-88ab-3b1fbb6ba3bb tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:19.204781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-57af35ac-4197-4321-88ab-3b1fbb6ba3bb tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:19.211057 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-57af35ac-4197-4321-88ab-3b1fbb6ba3bb tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:19.211478 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-57af35ac-4197-4321-88ab-3b1fbb6ba3bb tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:19.212298 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-57af35ac-4197-4321-88ab-3b1fbb6ba3bb tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:19.212692 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-57af35ac-4197-4321-88ab-3b1fbb6ba3bb tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:19.454235 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-57af35ac-4197-4321-88ab-3b1fbb6ba3bb tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:19.462293 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-57af35ac-4197-4321-88ab-3b1fbb6ba3bb tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1749 microversion: 2.1 time: 0.261866 Nov 16 19:11:19.462879 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 454/930] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:19 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1749 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:20.160108 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2fab27ed-880e-4840-8b01-be0eb1320354 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:20.160808 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2fab27ed-880e-4840-8b01-be0eb1320354 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:20.166875 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2fab27ed-880e-4840-8b01-be0eb1320354 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:20.167328 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2fab27ed-880e-4840-8b01-be0eb1320354 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:20.168104 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2fab27ed-880e-4840-8b01-be0eb1320354 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:20.168542 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2fab27ed-880e-4840-8b01-be0eb1320354 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:20.300000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2fab27ed-880e-4840-8b01-be0eb1320354 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:20.307189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2fab27ed-880e-4840-8b01-be0eb1320354 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.151545 Nov 16 19:11:20.307754 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 477/931] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:20 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:20.479921 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a7d3fd2d-9eff-4c7e-8dde-fb294804ebdf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:20.480444 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a7d3fd2d-9eff-4c7e-8dde-fb294804ebdf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:20.486702 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd2d-9eff-4c7e-8dde-fb294804ebdf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:20.487135 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd2d-9eff-4c7e-8dde-fb294804ebdf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:20.487989 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd2d-9eff-4c7e-8dde-fb294804ebdf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:20.488413 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a7d3fd2d-9eff-4c7e-8dde-fb294804ebdf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:20.675644 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a7d3fd2d-9eff-4c7e-8dde-fb294804ebdf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:20.683344 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a7d3fd2d-9eff-4c7e-8dde-fb294804ebdf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.207118 Nov 16 19:11:20.683910 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 455/932] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:20 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:20.866957 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-b2daa289-f869-474b-bf83-2e00600d5da8 req-0ab39b16-3f66-428b-bb32-41d3fd299ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cebd59d-87d0-453a-a5de-0af744f39fa4", "name": "network-vif-plugged", "status": "completed", "tag": "f1ba6b6f-e867-475e-951d-89b162884955"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:11:20.868503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:11:20.868503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:11:20.876020 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-b2daa289-f869-474b-bf83-2e00600d5da8 req-0ab39b16-3f66-428b-bb32-41d3fd299ad2 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:20.876556 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-b2daa289-f869-474b-bf83-2e00600d5da8 req-0ab39b16-3f66-428b-bb32-41d3fd299ad2 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:20.887389 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-b2daa289-f869-474b-bf83-2e00600d5da8 req-0ab39b16-3f66-428b-bb32-41d3fd299ad2 service nova] Creating event network-vif-plugged:f1ba6b6f-e867-475e-951d-89b162884955 for instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 on hv-cinder-66710 Nov 16 19:11:20.892603 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-b2daa289-f869-474b-bf83-2e00600d5da8 req-0ab39b16-3f66-428b-bb32-41d3fd299ad2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029330 Nov 16 19:11:20.893330 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 478/933] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:11:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:11:21.330776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2ad8879e-2567-4fcf-a70e-593dcc3404b9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:21.331373 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2ad8879e-2567-4fcf-a70e-593dcc3404b9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:21.337226 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ad8879e-2567-4fcf-a70e-593dcc3404b9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:21.337699 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ad8879e-2567-4fcf-a70e-593dcc3404b9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:21.338460 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ad8879e-2567-4fcf-a70e-593dcc3404b9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:21.338886 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2ad8879e-2567-4fcf-a70e-593dcc3404b9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:21.467765 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2ad8879e-2567-4fcf-a70e-593dcc3404b9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:21.474971 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2ad8879e-2567-4fcf-a70e-593dcc3404b9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1264 microversion: 2.1 time: 0.147873 Nov 16 19:11:21.475531 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 456/934] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:21 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:21.702440 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-81049dec-61de-4ecd-a221-f9dc0d52a589 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:21.703075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-81049dec-61de-4ecd-a221-f9dc0d52a589 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:21.709083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81049dec-61de-4ecd-a221-f9dc0d52a589 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:21.709531 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81049dec-61de-4ecd-a221-f9dc0d52a589 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:21.710325 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81049dec-61de-4ecd-a221-f9dc0d52a589 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:21.710754 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81049dec-61de-4ecd-a221-f9dc0d52a589 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:21.904949 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-81049dec-61de-4ecd-a221-f9dc0d52a589 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:21.912665 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-81049dec-61de-4ecd-a221-f9dc0d52a589 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.214790 Nov 16 19:11:21.913214 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 479/935] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:21 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:22.493193 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-293891d7-1e10-4c6f-8ef4-788af2b39ecc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:22.493855 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-293891d7-1e10-4c6f-8ef4-788af2b39ecc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:22.501024 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-293891d7-1e10-4c6f-8ef4-788af2b39ecc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:22.501474 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-293891d7-1e10-4c6f-8ef4-788af2b39ecc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:22.502271 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-293891d7-1e10-4c6f-8ef4-788af2b39ecc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:22.502704 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-293891d7-1e10-4c6f-8ef4-788af2b39ecc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:22.633874 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-293891d7-1e10-4c6f-8ef4-788af2b39ecc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:22.641768 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-293891d7-1e10-4c6f-8ef4-788af2b39ecc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1451 microversion: 2.1 time: 0.152248 Nov 16 19:11:22.642317 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 457/936] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:22 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:22.657393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-241bf37e-6438-4f06-86a2-d2f706492abf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:22.658034 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-241bf37e-6438-4f06-86a2-d2f706492abf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:22.663723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-241bf37e-6438-4f06-86a2-d2f706492abf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:22.664174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-241bf37e-6438-4f06-86a2-d2f706492abf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:22.664944 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-241bf37e-6438-4f06-86a2-d2f706492abf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:22.665376 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-241bf37e-6438-4f06-86a2-d2f706492abf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:22.803665 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-241bf37e-6438-4f06-86a2-d2f706492abf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:22.811501 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-241bf37e-6438-4f06-86a2-d2f706492abf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1451 microversion: 2.1 time: 0.157104 Nov 16 19:11:22.812059 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 480/937] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:22 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:22.930054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2433c815-a959-4c39-a18b-b417c5188939 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:22.930681 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2433c815-a959-4c39-a18b-b417c5188939 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:22.937221 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2433c815-a959-4c39-a18b-b417c5188939 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:22.937684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2433c815-a959-4c39-a18b-b417c5188939 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:22.938447 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2433c815-a959-4c39-a18b-b417c5188939 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:22.938878 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2433c815-a959-4c39-a18b-b417c5188939 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:23.081253 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-2433c815-a959-4c39-a18b-b417c5188939 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:23.089189 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2433c815-a959-4c39-a18b-b417c5188939 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.163286 Nov 16 19:11:23.089684 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 458/938] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:22 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:24.106148 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9999dc2c-145e-46a5-98d2-8385f1f50b57 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:24.106889 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9999dc2c-145e-46a5-98d2-8385f1f50b57 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:24.113096 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9999dc2c-145e-46a5-98d2-8385f1f50b57 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:24.113577 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9999dc2c-145e-46a5-98d2-8385f1f50b57 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:24.114351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9999dc2c-145e-46a5-98d2-8385f1f50b57 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:24.114873 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9999dc2c-145e-46a5-98d2-8385f1f50b57 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:24.363222 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9999dc2c-145e-46a5-98d2-8385f1f50b57 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:24.371057 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9999dc2c-145e-46a5-98d2-8385f1f50b57 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.268537 Nov 16 19:11:24.371612 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 481/939] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:24 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:24.481256 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-34726c4d-66b8-4deb-9fa4-92f9ecc3e6b2 req-5e86e3d9-baf8-4cc5-b37f-ad186d81c594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cebd59d-87d0-453a-a5de-0af744f39fa4", "tag": "f1ba6b6f-e867-475e-951d-89b162884955"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:11:24.482959 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:11:24.482959 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:11:24.491737 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-34726c4d-66b8-4deb-9fa4-92f9ecc3e6b2 req-5e86e3d9-baf8-4cc5-b37f-ad186d81c594 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:24.492442 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-34726c4d-66b8-4deb-9fa4-92f9ecc3e6b2 req-5e86e3d9-baf8-4cc5-b37f-ad186d81c594 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:24.505492 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-34726c4d-66b8-4deb-9fa4-92f9ecc3e6b2 req-5e86e3d9-baf8-4cc5-b37f-ad186d81c594 service nova] Creating event network-changed:f1ba6b6f-e867-475e-951d-89b162884955 for instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 on hv-cinder-66710 Nov 16 19:11:24.510290 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-34726c4d-66b8-4deb-9fa4-92f9ecc3e6b2 req-5e86e3d9-baf8-4cc5-b37f-ad186d81c594 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032605 Nov 16 19:11:24.510878 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 459/940] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:11:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:11:25.387993 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fc7164e5-58e9-49d8-821d-789b1017d59d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:25.388601 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fc7164e5-58e9-49d8-821d-789b1017d59d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:25.395035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc7164e5-58e9-49d8-821d-789b1017d59d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:25.395487 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc7164e5-58e9-49d8-821d-789b1017d59d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:25.396268 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc7164e5-58e9-49d8-821d-789b1017d59d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:25.396707 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc7164e5-58e9-49d8-821d-789b1017d59d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:25.543149 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fc7164e5-58e9-49d8-821d-789b1017d59d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:25.552183 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fc7164e5-58e9-49d8-821d-789b1017d59d tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.167866 Nov 16 19:11:25.552750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 482/941] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:25 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:26.526478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:11:26.527107 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: Tue Nov 16 19:11:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:11:26.570088 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-167de87b-bef6-4873-b718-ab53fe370908 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:26.570770 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-167de87b-bef6-4873-b718-ab53fe370908 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:26.576882 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-167de87b-bef6-4873-b718-ab53fe370908 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:26.577320 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-167de87b-bef6-4873-b718-ab53fe370908 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:26.578665 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-167de87b-bef6-4873-b718-ab53fe370908 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:26.579090 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-167de87b-bef6-4873-b718-ab53fe370908 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:26.717915 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-167de87b-bef6-4873-b718-ab53fe370908 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:26.726143 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-167de87b-bef6-4873-b718-ab53fe370908 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.160497 Nov 16 19:11:26.726695 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 460/942] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:26 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:27.743393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eddb5fd9-f1ba-4d6d-a6a9-93d384400d92 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:27.743988 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eddb5fd9-f1ba-4d6d-a6a9-93d384400d92 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:27.750992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eddb5fd9-f1ba-4d6d-a6a9-93d384400d92 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:27.751438 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eddb5fd9-f1ba-4d6d-a6a9-93d384400d92 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:27.752193 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eddb5fd9-f1ba-4d6d-a6a9-93d384400d92 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:27.752618 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eddb5fd9-f1ba-4d6d-a6a9-93d384400d92 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:27.896501 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eddb5fd9-f1ba-4d6d-a6a9-93d384400d92 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:27.904165 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eddb5fd9-f1ba-4d6d-a6a9-93d384400d92 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.164406 Nov 16 19:11:27.904711 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 483/943] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:27 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:11:28.921050 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a912388b-ed9a-494f-8aa5-9e23cab2248b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:28.922204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a912388b-ed9a-494f-8aa5-9e23cab2248b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:28.928674 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a912388b-ed9a-494f-8aa5-9e23cab2248b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:28.929112 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a912388b-ed9a-494f-8aa5-9e23cab2248b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:28.929898 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a912388b-ed9a-494f-8aa5-9e23cab2248b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:28.930323 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a912388b-ed9a-494f-8aa5-9e23cab2248b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:29.072149 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a912388b-ed9a-494f-8aa5-9e23cab2248b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:29.080002 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a912388b-ed9a-494f-8aa5-9e23cab2248b tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.162627 Nov 16 19:11:29.080574 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 461/944] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:28 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:30.097532 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-49d4f349-2e12-4459-8be0-b79c3b332fc7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:30.098204 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-49d4f349-2e12-4459-8be0-b79c3b332fc7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:30.104129 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49d4f349-2e12-4459-8be0-b79c3b332fc7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:30.104584 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49d4f349-2e12-4459-8be0-b79c3b332fc7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:30.105354 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49d4f349-2e12-4459-8be0-b79c3b332fc7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:30.105819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49d4f349-2e12-4459-8be0-b79c3b332fc7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:30.247611 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-49d4f349-2e12-4459-8be0-b79c3b332fc7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:30.255512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-49d4f349-2e12-4459-8be0-b79c3b332fc7 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1754 microversion: 2.1 time: 0.162167 Nov 16 19:11:30.256073 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 484/945] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:30 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:11:31.274098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-00b2a9c0-f60a-4fdb-bc8c-f53d8b4e7ce0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:11:31.274701 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-00b2a9c0-f60a-4fdb-bc8c-f53d8b4e7ce0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:11:31.280525 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-00b2a9c0-f60a-4fdb-bc8c-f53d8b4e7ce0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:31.281580 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-00b2a9c0-f60a-4fdb-bc8c-f53d8b4e7ce0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:31.282359 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-00b2a9c0-f60a-4fdb-bc8c-f53d8b4e7ce0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:11:31.282793 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-00b2a9c0-f60a-4fdb-bc8c-f53d8b4e7ce0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:11:31.422861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-00b2a9c0-f60a-4fdb-bc8c-f53d8b4e7ce0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:11:31.430690 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-00b2a9c0-f60a-4fdb-bc8c-f53d8b4e7ce0 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1757 microversion: 2.1 time: 0.160384 Nov 16 19:11:31.431258 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 462/946] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:11:31 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:06.727897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e713b29c-e9b5-4dfe-bac8-a1079a6a4ba4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-96818900"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:12:06.728472 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e713b29c-e9b5-4dfe-bac8-a1079a6a4ba4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:06.734419 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e713b29c-e9b5-4dfe-bac8-a1079a6a4ba4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:06.734879 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e713b29c-e9b5-4dfe-bac8-a1079a6a4ba4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:06.735659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e713b29c-e9b5-4dfe-bac8-a1079a6a4ba4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:06.736099 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e713b29c-e9b5-4dfe-bac8-a1079a6a4ba4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:06.864553 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.network.security_group_api [None req-e713b29c-e9b5-4dfe-bac8-a1079a6a4ba4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Removing security group 079795f4-4566-4d09-9384-e04e622afcb4 from port 64bb2f75-c646-411c-a0ed-f1eff8a865b6 Nov 16 19:12:07.192748 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e713b29c-e9b5-4dfe-bac8-a1079a6a4ba4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "POST /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/action" status: 202 len: 0 microversion: 2.1 time: 0.469202 Nov 16 19:12:07.209353 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 485/947] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:12:06 2021] POST /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:12:07.220611 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-e7ab75c3-635a-4944-a997-19ddb037b8d9 req-e46b3518-a7a6-45b1-b44d-d0cdcb730276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb255369-3900-4aea-a2e5-a1fb5374763c", "tag": "64bb2f75-c646-411c-a0ed-f1eff8a865b6"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:12:07.223342 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:12:07.223342 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:12:07.245326 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-e7ab75c3-635a-4944-a997-19ddb037b8d9 req-e46b3518-a7a6-45b1-b44d-d0cdcb730276 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:07.250646 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-e7ab75c3-635a-4944-a997-19ddb037b8d9 req-e46b3518-a7a6-45b1-b44d-d0cdcb730276 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:07.269155 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-e7ab75c3-635a-4944-a997-19ddb037b8d9 req-e46b3518-a7a6-45b1-b44d-d0cdcb730276 service nova] Creating event network-changed:64bb2f75-c646-411c-a0ed-f1eff8a865b6 for instance bb255369-3900-4aea-a2e5-a1fb5374763c on hv-cinder-66710 Nov 16 19:12:07.279379 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-e7ab75c3-635a-4944-a997-19ddb037b8d9 req-e46b3518-a7a6-45b1-b44d-d0cdcb730276 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077331 Nov 16 19:12:07.284071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 463/948] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:12:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:12:08.612756 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3a485bcd-4372-48ee-80b5-70af12597b74 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:08.613255 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3a485bcd-4372-48ee-80b5-70af12597b74 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:08.619180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a485bcd-4372-48ee-80b5-70af12597b74 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:08.619633 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a485bcd-4372-48ee-80b5-70af12597b74 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:08.620411 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a485bcd-4372-48ee-80b5-70af12597b74 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:08.620859 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a485bcd-4372-48ee-80b5-70af12597b74 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:08.698105 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-3a485bcd-4372-48ee-80b5-70af12597b74 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lazy-loading 'services' on Instance uuid bb255369-3900-4aea-a2e5-a1fb5374763c {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:12:08.767029 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3a485bcd-4372-48ee-80b5-70af12597b74 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments/e544422f-d8d2-4520-84ad-1985742d0ee8" status: 202 len: 0 microversion: 2.1 time: 0.158393 Nov 16 19:12:08.767936 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 486/949] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:12:08 2021] DELETE /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments/e544422f-d8d2-4520-84ad-1985742d0ee8 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:12:08.777165 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-123f31d1-2abd-42bb-a883-8d600afeadf4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:08.778265 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-123f31d1-2abd-42bb-a883-8d600afeadf4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:08.785587 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-123f31d1-2abd-42bb-a883-8d600afeadf4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:08.786360 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-123f31d1-2abd-42bb-a883-8d600afeadf4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:08.787064 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-123f31d1-2abd-42bb-a883-8d600afeadf4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:08.787541 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-123f31d1-2abd-42bb-a883-8d600afeadf4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:08.818652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-123f31d1-2abd-42bb-a883-8d600afeadf4 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046043 Nov 16 19:12:08.823021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 464/950] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:12:08 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:12:09.295727 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-38ce1dcd-a294-4467-a251-a321e8d7ad3b req-ff7686d0-3ef5-4da9-a828-ae2008c511bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb255369-3900-4aea-a2e5-a1fb5374763c", "tag": "64bb2f75-c646-411c-a0ed-f1eff8a865b6"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:12:09.297361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:12:09.297361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:12:09.306815 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-38ce1dcd-a294-4467-a251-a321e8d7ad3b req-ff7686d0-3ef5-4da9-a828-ae2008c511bb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:09.307263 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-38ce1dcd-a294-4467-a251-a321e8d7ad3b req-ff7686d0-3ef5-4da9-a828-ae2008c511bb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:09.320255 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-38ce1dcd-a294-4467-a251-a321e8d7ad3b req-ff7686d0-3ef5-4da9-a828-ae2008c511bb service nova] Creating event network-changed:64bb2f75-c646-411c-a0ed-f1eff8a865b6 for instance bb255369-3900-4aea-a2e5-a1fb5374763c on hv-cinder-66710 Nov 16 19:12:09.325052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-38ce1dcd-a294-4467-a251-a321e8d7ad3b req-ff7686d0-3ef5-4da9-a828-ae2008c511bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033900 Nov 16 19:12:09.325847 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 487/951] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:12:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:12:09.830588 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6d60468d-89b9-4910-a29e-a485aad02793 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:09.831503 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6d60468d-89b9-4910-a29e-a485aad02793 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:09.838545 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6d60468d-89b9-4910-a29e-a485aad02793 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:09.839046 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6d60468d-89b9-4910-a29e-a485aad02793 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:09.839824 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6d60468d-89b9-4910-a29e-a485aad02793 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:09.840468 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6d60468d-89b9-4910-a29e-a485aad02793 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:09.870814 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6d60468d-89b9-4910-a29e-a485aad02793 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043940 Nov 16 19:12:09.871365 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 465/952] 10.222.0.46 () {58 vars in 1301 bytes} [Tue Nov 16 19:12:09 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 19:12:09.881843 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:09.882447 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:09.888768 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:09.889213 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:09.890012 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:09.890450 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:09.959384 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] HTTP exception thrown: Instance bb255369-3900-4aea-a2e5-a1fb5374763c is not attached to volume e544422f-d8d2-4520-84ad-1985742d0ee8 Nov 16 19:12:09.959971 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Returning 404 to user: Instance bb255369-3900-4aea-a2e5-a1fb5374763c is not attached to volume e544422f-d8d2-4520-84ad-1985742d0ee8 {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:12:09.961325 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dfdaf584-7ef0-4a1c-a90d-c3d4c1883ccf tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments/e544422f-d8d2-4520-84ad-1985742d0ee8" status: 404 len: 154 microversion: 2.1 time: 0.083666 Nov 16 19:12:09.961888 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 488/953] 10.222.0.46 () {58 vars in 1415 bytes} [Tue Nov 16 19:12:09 2021] DELETE /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c/os-volume_attachments/e544422f-d8d2-4520-84ad-1985742d0ee8 => generated 154 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:12:11.087116 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bbd70cab-5c63-42c7-a028-1f8b21db7450 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:11.087601 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bbd70cab-5c63-42c7-a028-1f8b21db7450 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:11.093895 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbd70cab-5c63-42c7-a028-1f8b21db7450 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:11.094335 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbd70cab-5c63-42c7-a028-1f8b21db7450 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:11.095097 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbd70cab-5c63-42c7-a028-1f8b21db7450 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:11.095521 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bbd70cab-5c63-42c7-a028-1f8b21db7450 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:11.120508 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bbd70cab-5c63-42c7-a028-1f8b21db7450 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:12:11.196013 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bbd70cab-5c63-42c7-a028-1f8b21db7450 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 204 len: 0 microversion: 2.1 time: 0.111845 Nov 16 19:12:11.197008 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 466/954] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:12:11 2021] DELETE /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:12:11.205416 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-21328493-75a3-48c9-ab3b-b39e4594cfbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:11.206800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-21328493-75a3-48c9-ab3b-b39e4594cfbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:11.215664 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21328493-75a3-48c9-ab3b-b39e4594cfbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:11.216369 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21328493-75a3-48c9-ab3b-b39e4594cfbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:11.217338 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21328493-75a3-48c9-ab3b-b39e4594cfbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:11.217958 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21328493-75a3-48c9-ab3b-b39e4594cfbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:11.358216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-21328493-75a3-48c9-ab3b-b39e4594cfbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:11.367842 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-21328493-75a3-48c9-ab3b-b39e4594cfbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1554 microversion: 2.1 time: 0.166344 Nov 16 19:12:11.368629 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 489/955] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:11 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:12.386202 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-add6b428-3543-44be-9b68-3da79a4ab170 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:12.386895 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-add6b428-3543-44be-9b68-3da79a4ab170 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:12.393152 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-add6b428-3543-44be-9b68-3da79a4ab170 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:12.393635 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-add6b428-3543-44be-9b68-3da79a4ab170 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:12.394402 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-add6b428-3543-44be-9b68-3da79a4ab170 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:12.394831 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-add6b428-3543-44be-9b68-3da79a4ab170 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:12.522043 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-add6b428-3543-44be-9b68-3da79a4ab170 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:12.529299 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-add6b428-3543-44be-9b68-3da79a4ab170 tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1554 microversion: 2.1 time: 0.147598 Nov 16 19:12:12.529890 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 467/956] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:12 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:13.456258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-37aa2f61-cd9f-435b-af02-8cdb9e780b34 req-298d0c47-a0f8-4851-ad8b-831a245b7b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb255369-3900-4aea-a2e5-a1fb5374763c", "name": "network-vif-deleted", "tag": "64bb2f75-c646-411c-a0ed-f1eff8a865b6"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:12:13.457893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:12:13.457893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:12:13.465442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-37aa2f61-cd9f-435b-af02-8cdb9e780b34 req-298d0c47-a0f8-4851-ad8b-831a245b7b3f service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:13.465911 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-37aa2f61-cd9f-435b-af02-8cdb9e780b34 req-298d0c47-a0f8-4851-ad8b-831a245b7b3f service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:13.477780 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-37aa2f61-cd9f-435b-af02-8cdb9e780b34 req-298d0c47-a0f8-4851-ad8b-831a245b7b3f service nova] Creating event network-vif-deleted:64bb2f75-c646-411c-a0ed-f1eff8a865b6 for instance bb255369-3900-4aea-a2e5-a1fb5374763c on hv-cinder-66710 Nov 16 19:12:13.483959 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-37aa2f61-cd9f-435b-af02-8cdb9e780b34 req-298d0c47-a0f8-4851-ad8b-831a245b7b3f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031322 Nov 16 19:12:13.484546 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 490/957] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:12:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:12:13.545803 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:13.546408 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:13.552571 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:13.553043 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:13.554378 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:13.554818 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:13.585837 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:13.586299 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:13.586770 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lazy-loading 'fault' on Instance uuid bb255369-3900-4aea-a2e5-a1fb5374763c {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:12:13.624535 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4f4f6469d4647428471743e0ecbb1b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b043ff8fd5b4a328d325072a1c372d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:13.631876 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cc3299fa-728a-4f3b-8f05-f528d6d665ec tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 200 len: 1348 microversion: 2.1 time: 0.089716 Nov 16 19:12:13.633021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 468/958] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:13 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:14.650893 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:14.651586 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] [instance: bb255369-3900-4aea-a2e5-a1fb5374763c] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:14.658059 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:14.658505 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:14.659276 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:14.659710 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:14.672844 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] HTTP exception thrown: Instance bb255369-3900-4aea-a2e5-a1fb5374763c could not be found. Nov 16 19:12:14.673419 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Returning 404 to user: Instance bb255369-3900-4aea-a2e5-a1fb5374763c could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:12:14.674258 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-415c9c85-3872-453a-8e6f-d59f6500cbcc tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c" status: 404 len: 111 microversion: 2.1 time: 0.027999 Nov 16 19:12:14.674815 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 491/959] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:14 2021] GET /compute/v2.1/servers/bb255369-3900-4aea-a2e5-a1fb5374763c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:12:14.682935 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fc41f044-0993-42b7-9ec3-f37da28d7dbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] Calling method '.version_select at 0x7ffa56cca8b0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:14.699892 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fc41f044-0993-42b7-9ec3-f37da28d7dbd tempest-TestMinimumBasicScenario-2072749236 tempest-TestMinimumBasicScenario-2072749236-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1956645032" status: 202 len: 0 microversion: 2.1 time: 0.020558 Nov 16 19:12:14.700424 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 469/960] 10.222.0.46 () {58 vars in 1271 bytes} [Tue Nov 16 19:12:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1956645032 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:12:31.961066 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6a85ebae-cadc-4c7f-a266-95b4390a62be tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Action: 'create', calling method: .version_select at 0x7ffa56bddf70>, body: {"keypair": {"name": "tempest-TestShelveInstance-510977476"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:12:31.974518 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-6a85ebae-cadc-4c7f-a266-95b4390a62be tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Getting quotas for project 64eef6e0383c42f39e24aff3690b58fa. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:12:31.978312 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-6a85ebae-cadc-4c7f-a266-95b4390a62be tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Getting quotas for user aba65da1f1ab442a9d2516d3a8b18e83 and project 64eef6e0383c42f39e24aff3690b58fa. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:12:32.180221 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-6a85ebae-cadc-4c7f-a266-95b4390a62be tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Getting quotas for project 64eef6e0383c42f39e24aff3690b58fa. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:12:32.183976 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-6a85ebae-cadc-4c7f-a266-95b4390a62be tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Getting quotas for user aba65da1f1ab442a9d2516d3a8b18e83 and project 64eef6e0383c42f39e24aff3690b58fa. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:12:32.198621 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6a85ebae-cadc-4c7f-a266-95b4390a62be tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.404643 Nov 16 19:12:32.199505 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 492/961] 10.222.0.46 () {60 vars in 1157 bytes} [Tue Nov 16 19:12:31 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:50.335966 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1312138798", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-510977476", "security_groups": [{"name": "tempest-secgroup-smoke-1030065430"}], "networks": [{"uuid": "33fd3960-6c3f-4161-8d19-bd407c7a0dc6"}], "block_device_mapping_v2": [{"uuid": "0a12cdbb-d1f5-41ed-a05e-3898a87af363", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:12:50.442522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.network.neutron [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] validate_networks() for [('33fd3960-6c3f-4161-8d19-bd407c7a0dc6', None, None, None, None, None)] {{(pid=116169) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:12:50.896604 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Flavor limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:12:50.897026 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Image limits 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:12:50.897499 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Flavor pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:12:50.897939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Image pref 0:0:0 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:12:50.898368 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.virt.hardware [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116169) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:12:50.906943 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:50.907388 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:50.908188 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:50.908619 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:50.924898 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Getting quotas for project 64eef6e0383c42f39e24aff3690b58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:12:50.928763 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.quota [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Getting quotas for user aba65da1f1ab442a9d2516d3a8b18e83 and project 64eef6e0383c42f39e24aff3690b58fa. Resources: {'instances', 'ram', 'cores'} {{(pid=116169) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:12:50.982240 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Going to run 1 instances... {{(pid=116169) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:12:50.984362 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a12cdbb-d1f5-41ed-a05e-3898a87af363',volume_size=None,volume_type=None)] {{(pid=116169) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:12:51.101389 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [2f7179b1-4bbc-4857-a62a-e3e92aa77adc] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 16 19:12:52.119206 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO oslo.messaging._drivers.impl_rabbit [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [2f7179b1-4bbc-4857-a62a-e3e92aa77adc] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41032. Nov 16 19:12:52.123277 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0fb3924e-5815-4561-883f-194d495ac79d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.791672 Nov 16 19:12:52.123926 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 470/962] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:12:50 2021] POST /compute/v2.1/servers => generated 406 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 19:12:52.133896 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e4909a05-7017-4d05-8141-38c82fbfbb45 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:52.134601 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e4909a05-7017-4d05-8141-38c82fbfbb45 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:52.187711 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e4909a05-7017-4d05-8141-38c82fbfbb45 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:52.194828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e4909a05-7017-4d05-8141-38c82fbfbb45 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1088 microversion: 2.1 time: 0.064648 Nov 16 19:12:52.195871 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 493/963] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:52 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:53.212349 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f00f5fc4-6a5f-4587-a6ba-58fbbd19570d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:53.213039 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f00f5fc4-6a5f-4587-a6ba-58fbbd19570d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:53.264122 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f00f5fc4-6a5f-4587-a6ba-58fbbd19570d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:53.270664 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f00f5fc4-6a5f-4587-a6ba-58fbbd19570d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1088 microversion: 2.1 time: 0.062465 Nov 16 19:12:53.271223 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 471/964] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:53 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1088 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:54.287771 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6664f425-cb8d-471f-9bbf-eb8c20c9e948 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:54.288365 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6664f425-cb8d-471f-9bbf-eb8c20c9e948 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:54.346754 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6664f425-cb8d-471f-9bbf-eb8c20c9e948 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:54.353196 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6664f425-cb8d-471f-9bbf-eb8c20c9e948 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1088 microversion: 2.1 time: 0.069105 Nov 16 19:12:54.354406 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 494/965] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:54 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:55.370256 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f237f669-15be-4444-9c6e-dc7946e615e2 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:55.370866 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f237f669-15be-4444-9c6e-dc7946e615e2 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:55.425360 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f237f669-15be-4444-9c6e-dc7946e615e2 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:55.432259 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f237f669-15be-4444-9c6e-dc7946e615e2 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1088 microversion: 2.1 time: 0.065633 Nov 16 19:12:55.432814 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 472/966] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:55 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:56.449288 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b0d8ff80-b1c3-4e3e-8019-0b6dc4aebda0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:56.449910 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b0d8ff80-b1c3-4e3e-8019-0b6dc4aebda0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:56.456568 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0d8ff80-b1c3-4e3e-8019-0b6dc4aebda0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:56.457009 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0d8ff80-b1c3-4e3e-8019-0b6dc4aebda0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:56.457799 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0d8ff80-b1c3-4e3e-8019-0b6dc4aebda0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:56.458228 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0d8ff80-b1c3-4e3e-8019-0b6dc4aebda0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:56.515020 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b0d8ff80-b1c3-4e3e-8019-0b6dc4aebda0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:56.522224 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b0d8ff80-b1c3-4e3e-8019-0b6dc4aebda0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1138 microversion: 2.1 time: 0.077157 Nov 16 19:12:56.522780 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 495/967] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:56 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1138 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:57.538920 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5cf85850-94dc-4c40-b41d-f2aacf1f2e72 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:57.540244 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5cf85850-94dc-4c40-b41d-f2aacf1f2e72 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:57.546840 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5cf85850-94dc-4c40-b41d-f2aacf1f2e72 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:57.547285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5cf85850-94dc-4c40-b41d-f2aacf1f2e72 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:57.548068 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5cf85850-94dc-4c40-b41d-f2aacf1f2e72 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:57.548496 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5cf85850-94dc-4c40-b41d-f2aacf1f2e72 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:57.660252 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5cf85850-94dc-4c40-b41d-f2aacf1f2e72 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:57.668004 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5cf85850-94dc-4c40-b41d-f2aacf1f2e72 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1204 microversion: 2.1 time: 0.132697 Nov 16 19:12:57.668582 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 473/968] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:57 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1204 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:12:58.684829 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ac6752c7-e4b9-4dfc-8a99-d2edf7389e35 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:58.686267 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ac6752c7-e4b9-4dfc-8a99-d2edf7389e35 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:58.693241 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ac6752c7-e4b9-4dfc-8a99-d2edf7389e35 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:58.693732 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ac6752c7-e4b9-4dfc-8a99-d2edf7389e35 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:58.694518 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ac6752c7-e4b9-4dfc-8a99-d2edf7389e35 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:58.694953 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ac6752c7-e4b9-4dfc-8a99-d2edf7389e35 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:58.836819 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-b4bddae5-6789-43f1-99d5-ede702bbe60e req-b9bb74a6-7df9-40f7-88ef-7235747db856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811", "tag": "09ee89b4-ca67-46d8-a2ca-e497e063a615"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:12:58.839037 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:12:58.839037 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:12:58.849528 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ac6752c7-e4b9-4dfc-8a99-d2edf7389e35 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:12:58.854093 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-b4bddae5-6789-43f1-99d5-ede702bbe60e req-b9bb74a6-7df9-40f7-88ef-7235747db856 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:58.854538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-b4bddae5-6789-43f1-99d5-ede702bbe60e req-b9bb74a6-7df9-40f7-88ef-7235747db856 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:58.863328 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ac6752c7-e4b9-4dfc-8a99-d2edf7389e35 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.181998 Nov 16 19:12:58.863942 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 496/969] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:58 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:12:58.879067 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-b4bddae5-6789-43f1-99d5-ede702bbe60e req-b9bb74a6-7df9-40f7-88ef-7235747db856 service nova] Creating event network-changed:09ee89b4-ca67-46d8-a2ca-e497e063a615 for instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 on hv-cinder-66710 Nov 16 19:12:58.884110 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-b4bddae5-6789-43f1-99d5-ede702bbe60e req-b9bb74a6-7df9-40f7-88ef-7235747db856 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128155 Nov 16 19:12:58.884896 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 474/970] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:12:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 19:12:59.880766 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5b0e4cbb-b2a3-4fa2-b7c6-048a8a17e390 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:12:59.881374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5b0e4cbb-b2a3-4fa2-b7c6-048a8a17e390 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:12:59.887683 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5b0e4cbb-b2a3-4fa2-b7c6-048a8a17e390 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:59.888120 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5b0e4cbb-b2a3-4fa2-b7c6-048a8a17e390 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:12:59.888882 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5b0e4cbb-b2a3-4fa2-b7c6-048a8a17e390 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:12:59.889312 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5b0e4cbb-b2a3-4fa2-b7c6-048a8a17e390 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:00.022948 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5b0e4cbb-b2a3-4fa2-b7c6-048a8a17e390 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:00.030164 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5b0e4cbb-b2a3-4fa2-b7c6-048a8a17e390 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.153285 Nov 16 19:13:00.030723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 497/971] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:12:59 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:01.047671 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-8ffce8a2-c8f4-4120-81a7-2c9b3fa8ee42 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:01.048381 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-8ffce8a2-c8f4-4120-81a7-2c9b3fa8ee42 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:01.054495 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ffce8a2-c8f4-4120-81a7-2c9b3fa8ee42 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:01.055445 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ffce8a2-c8f4-4120-81a7-2c9b3fa8ee42 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:01.056195 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ffce8a2-c8f4-4120-81a7-2c9b3fa8ee42 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:01.056622 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-8ffce8a2-c8f4-4120-81a7-2c9b3fa8ee42 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:01.184360 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-8ffce8a2-c8f4-4120-81a7-2c9b3fa8ee42 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:01.191567 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-8ffce8a2-c8f4-4120-81a7-2c9b3fa8ee42 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.147882 Nov 16 19:13:01.192117 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 475/972] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:01 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:02.207809 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-32ec95ac-f140-4d36-b1b2-7513534dfde0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:02.208409 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-32ec95ac-f140-4d36-b1b2-7513534dfde0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:02.214642 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32ec95ac-f140-4d36-b1b2-7513534dfde0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:02.215083 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32ec95ac-f140-4d36-b1b2-7513534dfde0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:02.215846 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32ec95ac-f140-4d36-b1b2-7513534dfde0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:02.216274 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32ec95ac-f140-4d36-b1b2-7513534dfde0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:02.343991 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-32ec95ac-f140-4d36-b1b2-7513534dfde0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:02.354216 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-32ec95ac-f140-4d36-b1b2-7513534dfde0 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.149976 Nov 16 19:13:02.354763 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 498/973] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:02 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:03.371225 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-e3ca2193-a1ee-4e22-818b-d664e4ab7cd5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:03.371820 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-e3ca2193-a1ee-4e22-818b-d664e4ab7cd5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:03.378369 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e3ca2193-a1ee-4e22-818b-d664e4ab7cd5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:03.378808 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e3ca2193-a1ee-4e22-818b-d664e4ab7cd5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:03.379560 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e3ca2193-a1ee-4e22-818b-d664e4ab7cd5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:03.379982 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-e3ca2193-a1ee-4e22-818b-d664e4ab7cd5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:03.512706 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-e3ca2193-a1ee-4e22-818b-d664e4ab7cd5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:03.519883 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-e3ca2193-a1ee-4e22-818b-d664e4ab7cd5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.152882 Nov 16 19:13:03.520431 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 476/974] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:03 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:04.536238 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-22bee89a-04b1-43ac-a71b-151edaea1002 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:04.536847 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-22bee89a-04b1-43ac-a71b-151edaea1002 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:04.543075 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22bee89a-04b1-43ac-a71b-151edaea1002 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:04.543528 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22bee89a-04b1-43ac-a71b-151edaea1002 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:04.544302 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22bee89a-04b1-43ac-a71b-151edaea1002 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:04.544743 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22bee89a-04b1-43ac-a71b-151edaea1002 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:04.678948 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-22bee89a-04b1-43ac-a71b-151edaea1002 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:04.686724 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-22bee89a-04b1-43ac-a71b-151edaea1002 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.154143 Nov 16 19:13:04.687275 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 499/975] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:04 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:05.703111 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-590f0015-bead-4919-9454-7839ada74edf tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:05.703722 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-590f0015-bead-4919-9454-7839ada74edf tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:05.710062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-590f0015-bead-4919-9454-7839ada74edf tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:05.710510 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-590f0015-bead-4919-9454-7839ada74edf tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:05.711299 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-590f0015-bead-4919-9454-7839ada74edf tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:05.711716 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-590f0015-bead-4919-9454-7839ada74edf tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:05.840147 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-590f0015-bead-4919-9454-7839ada74edf tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:05.847325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-590f0015-bead-4919-9454-7839ada74edf tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.147862 Nov 16 19:13:05.847882 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 477/976] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:05 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:06.863992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2844795e-25b6-4d02-bdb1-9e36650a5d11 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:06.864607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2844795e-25b6-4d02-bdb1-9e36650a5d11 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:06.870835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2844795e-25b6-4d02-bdb1-9e36650a5d11 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:06.871286 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2844795e-25b6-4d02-bdb1-9e36650a5d11 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:06.872062 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2844795e-25b6-4d02-bdb1-9e36650a5d11 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:06.872505 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2844795e-25b6-4d02-bdb1-9e36650a5d11 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:06.999874 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2844795e-25b6-4d02-bdb1-9e36650a5d11 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:07.007297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2844795e-25b6-4d02-bdb1-9e36650a5d11 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.146996 Nov 16 19:13:07.007849 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 500/977] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:06 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:08.024216 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1c4077c2-e0a4-42cc-9d3c-df06c96ab7a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:08.024784 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1c4077c2-e0a4-42cc-9d3c-df06c96ab7a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:08.031054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1c4077c2-e0a4-42cc-9d3c-df06c96ab7a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:08.031499 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1c4077c2-e0a4-42cc-9d3c-df06c96ab7a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:08.032273 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1c4077c2-e0a4-42cc-9d3c-df06c96ab7a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:08.032711 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1c4077c2-e0a4-42cc-9d3c-df06c96ab7a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:08.159404 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1c4077c2-e0a4-42cc-9d3c-df06c96ab7a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:08.167030 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1c4077c2-e0a4-42cc-9d3c-df06c96ab7a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.146800 Nov 16 19:13:08.167586 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 478/978] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:08 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:09.184132 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-17b0c564-f8c7-44ab-a390-8798704e5a29 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:09.184741 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-17b0c564-f8c7-44ab-a390-8798704e5a29 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:09.191046 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17b0c564-f8c7-44ab-a390-8798704e5a29 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:09.191496 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17b0c564-f8c7-44ab-a390-8798704e5a29 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:09.192263 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17b0c564-f8c7-44ab-a390-8798704e5a29 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:09.192694 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17b0c564-f8c7-44ab-a390-8798704e5a29 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:09.324671 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-17b0c564-f8c7-44ab-a390-8798704e5a29 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:09.332351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-17b0c564-f8c7-44ab-a390-8798704e5a29 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.152375 Nov 16 19:13:09.332910 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 501/979] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:09 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:09.460934 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-4d973277-5473-4d54-9fc2-70090ba12326 req-ee71bfde-d1b4-49e8-bd4b-c7cf5bb13266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811", "name": "network-vif-plugged", "status": "completed", "tag": "09ee89b4-ca67-46d8-a2ca-e497e063a615"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:13:09.462599 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:13:09.462599 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:13:09.470107 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-4d973277-5473-4d54-9fc2-70090ba12326 req-ee71bfde-d1b4-49e8-bd4b-c7cf5bb13266 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:09.470550 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-4d973277-5473-4d54-9fc2-70090ba12326 req-ee71bfde-d1b4-49e8-bd4b-c7cf5bb13266 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:09.481675 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-4d973277-5473-4d54-9fc2-70090ba12326 req-ee71bfde-d1b4-49e8-bd4b-c7cf5bb13266 service nova] Creating event network-vif-plugged:09ee89b4-ca67-46d8-a2ca-e497e063a615 for instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 on hv-cinder-66710 Nov 16 19:13:09.486584 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-4d973277-5473-4d54-9fc2-70090ba12326 req-ee71bfde-d1b4-49e8-bd4b-c7cf5bb13266 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083631 Nov 16 19:13:09.487154 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 479/980] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:13:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:13:10.348037 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6356a33d-d071-4dae-8ca0-84dd574cd804 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:10.348638 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6356a33d-d071-4dae-8ca0-84dd574cd804 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:10.355090 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6356a33d-d071-4dae-8ca0-84dd574cd804 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:10.355536 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6356a33d-d071-4dae-8ca0-84dd574cd804 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:10.356309 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6356a33d-d071-4dae-8ca0-84dd574cd804 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:10.356743 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6356a33d-d071-4dae-8ca0-84dd574cd804 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:10.486607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6356a33d-d071-4dae-8ca0-84dd574cd804 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:10.493690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6356a33d-d071-4dae-8ca0-84dd574cd804 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1260 microversion: 2.1 time: 0.149300 Nov 16 19:13:10.494238 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 502/981] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:10 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:11.512200 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-68e3952b-fb1d-4781-b15d-d0ee0b34b621 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:11.512891 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-68e3952b-fb1d-4781-b15d-d0ee0b34b621 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:11.519477 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68e3952b-fb1d-4781-b15d-d0ee0b34b621 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:11.520020 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68e3952b-fb1d-4781-b15d-d0ee0b34b621 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:11.520899 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68e3952b-fb1d-4781-b15d-d0ee0b34b621 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:11.521341 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-68e3952b-fb1d-4781-b15d-d0ee0b34b621 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:11.655913 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-68e3952b-fb1d-4781-b15d-d0ee0b34b621 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:11.663124 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-68e3952b-fb1d-4781-b15d-d0ee0b34b621 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1445 microversion: 2.1 time: 0.156126 Nov 16 19:13:11.663682 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 480/982] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:11 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:11.678820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c23319a6-bcdc-4e5e-ba63-d7362ff1ceea tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:11.679430 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c23319a6-bcdc-4e5e-ba63-d7362ff1ceea tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:11.686176 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c23319a6-bcdc-4e5e-ba63-d7362ff1ceea tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:11.686616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c23319a6-bcdc-4e5e-ba63-d7362ff1ceea tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:11.687478 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c23319a6-bcdc-4e5e-ba63-d7362ff1ceea tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:11.692172 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c23319a6-bcdc-4e5e-ba63-d7362ff1ceea tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:11.821396 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c23319a6-bcdc-4e5e-ba63-d7362ff1ceea tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:11.828788 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c23319a6-bcdc-4e5e-ba63-d7362ff1ceea tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1445 microversion: 2.1 time: 0.153635 Nov 16 19:13:11.829339 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 503/983] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:11 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:13.427902 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-77b6866b-70b1-49ad-9d94-9c8c9894ae78 req-a16f66a0-a3b5-4c5c-a717-8402c15bd1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811", "tag": "09ee89b4-ca67-46d8-a2ca-e497e063a615"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:13:13.429592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:13:13.429592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:13:13.437362 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-77b6866b-70b1-49ad-9d94-9c8c9894ae78 req-a16f66a0-a3b5-4c5c-a717-8402c15bd1cb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:13.437816 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-77b6866b-70b1-49ad-9d94-9c8c9894ae78 req-a16f66a0-a3b5-4c5c-a717-8402c15bd1cb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:13.448875 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-77b6866b-70b1-49ad-9d94-9c8c9894ae78 req-a16f66a0-a3b5-4c5c-a717-8402c15bd1cb service nova] Creating event network-changed:09ee89b4-ca67-46d8-a2ca-e497e063a615 for instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 on hv-cinder-66710 Nov 16 19:13:13.454098 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-77b6866b-70b1-49ad-9d94-9c8c9894ae78 req-a16f66a0-a3b5-4c5c-a717-8402c15bd1cb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029626 Nov 16 19:13:13.455125 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 481/984] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:13:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:13:21.746006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-65b22392-b8b3-4c92-a64e-370d0cb9e5ee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:21.746569 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-65b22392-b8b3-4c92-a64e-370d0cb9e5ee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:21.752750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65b22392-b8b3-4c92-a64e-370d0cb9e5ee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:21.753450 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65b22392-b8b3-4c92-a64e-370d0cb9e5ee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:21.754232 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65b22392-b8b3-4c92-a64e-370d0cb9e5ee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:21.754663 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65b22392-b8b3-4c92-a64e-370d0cb9e5ee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:21.777636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-65b22392-b8b3-4c92-a64e-370d0cb9e5ee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:13:21.850098 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-65b22392-b8b3-4c92-a64e-370d0cb9e5ee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 204 len: 0 microversion: 2.1 time: 0.107884 Nov 16 19:13:21.850680 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 504/985] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:13:21 2021] DELETE /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:13:21.859715 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-311d17a8-0b56-4cfe-a2dd-ef6c66007efc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:21.860423 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-311d17a8-0b56-4cfe-a2dd-ef6c66007efc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:21.866820 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-311d17a8-0b56-4cfe-a2dd-ef6c66007efc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:21.867263 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-311d17a8-0b56-4cfe-a2dd-ef6c66007efc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:21.868033 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-311d17a8-0b56-4cfe-a2dd-ef6c66007efc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:21.868464 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-311d17a8-0b56-4cfe-a2dd-ef6c66007efc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:22.001099 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-311d17a8-0b56-4cfe-a2dd-ef6c66007efc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:22.008666 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-311d17a8-0b56-4cfe-a2dd-ef6c66007efc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1575 microversion: 2.1 time: 0.153114 Nov 16 19:13:22.009231 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 482/986] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:21 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:23.025328 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-03f642e1-0ec5-400b-996a-6afb783f8a56 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:23.026061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-03f642e1-0ec5-400b-996a-6afb783f8a56 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:23.032262 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03f642e1-0ec5-400b-996a-6afb783f8a56 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:23.032708 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03f642e1-0ec5-400b-996a-6afb783f8a56 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:23.033495 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03f642e1-0ec5-400b-996a-6afb783f8a56 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:23.033954 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03f642e1-0ec5-400b-996a-6afb783f8a56 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:23.163845 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-03f642e1-0ec5-400b-996a-6afb783f8a56 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:23.171663 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-03f642e1-0ec5-400b-996a-6afb783f8a56 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1575 microversion: 2.1 time: 0.150282 Nov 16 19:13:23.172231 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 505/987] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:23 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:24.189353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f7c2b3d8-1fbd-4e87-a25b-c0bee9940b3a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:24.190120 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f7c2b3d8-1fbd-4e87-a25b-c0bee9940b3a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:24.196651 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7c2b3d8-1fbd-4e87-a25b-c0bee9940b3a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:24.197165 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7c2b3d8-1fbd-4e87-a25b-c0bee9940b3a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:24.198078 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7c2b3d8-1fbd-4e87-a25b-c0bee9940b3a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:24.198597 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f7c2b3d8-1fbd-4e87-a25b-c0bee9940b3a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:24.260509 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f7c2b3d8-1fbd-4e87-a25b-c0bee9940b3a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:24.268518 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f7c2b3d8-1fbd-4e87-a25b-c0bee9940b3a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 200 len: 1508 microversion: 2.1 time: 0.082936 Nov 16 19:13:24.269086 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 483/988] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:24 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 1508 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:24.423043 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-40c0cc82-388e-49d6-b6f4-b1097249ea3c req-b5872a51-411d-4f16-ab41-c763bea2d34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cebd59d-87d0-453a-a5de-0af744f39fa4", "name": "network-vif-deleted", "tag": "f1ba6b6f-e867-475e-951d-89b162884955"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:13:24.424629 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:13:24.424629 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:13:24.434445 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-40c0cc82-388e-49d6-b6f4-b1097249ea3c req-b5872a51-411d-4f16-ab41-c763bea2d34e service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:24.434884 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-40c0cc82-388e-49d6-b6f4-b1097249ea3c req-b5872a51-411d-4f16-ab41-c763bea2d34e service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:24.446885 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-40c0cc82-388e-49d6-b6f4-b1097249ea3c req-b5872a51-411d-4f16-ab41-c763bea2d34e service nova] Creating event network-vif-deleted:f1ba6b6f-e867-475e-951d-89b162884955 for instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 on hv-cinder-66710 Nov 16 19:13:24.453607 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-40c0cc82-388e-49d6-b6f4-b1097249ea3c req-b5872a51-411d-4f16-ab41-c763bea2d34e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033688 Nov 16 19:13:24.454471 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 506/989] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:13:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:13:25.285011 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:25.286382 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:25.293681 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:25.294119 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:25.294890 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:25.295315 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:25.308771 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] HTTP exception thrown: Instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 could not be found. Nov 16 19:13:25.309387 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Returning 404 to user: Instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:13:25.310240 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cb7b4211-b739-4618-a224-7cd2707d40c9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 404 len: 111 microversion: 2.1 time: 0.028934 Nov 16 19:13:25.310776 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 484/990] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:25 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:13:25.405732 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-835793429", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-376292854", "security_groups": [{"name": "tempest-secgroup-smoke-470136781"}], "block_device_mapping_v2": [{"uuid": "9ebc6643-a8b8-4410-a72a-29fb302b6b47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8869448c-a462-4b3c-b5fc-a38ebbecc48e"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:13:25.513393 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] validate_networks() for [('8869448c-a462-4b3c-b5fc-a38ebbecc48e', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:13:26.089616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:13:26.090036 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:13:26.090541 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:13:26.090968 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:13:26.091378 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:13:26.100056 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:26.100502 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:26.101304 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:26.101771 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:26.117351 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for project ffaa0849f50740c491e5f247362c3b10. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:13:26.121174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for user 99e8dcf6fbda47a0b243239f62720c4a and project ffaa0849f50740c491e5f247362c3b10. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:13:26.174361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:13:26.176605 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ebc6643-a8b8-4410-a72a-29fb302b6b47',volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:13:26.293706 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3422797a-e8ad-47d0-9deb-f33de9a48cea tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.893024 Nov 16 19:13:26.294328 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 507/991] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:13:25 2021] POST /compute/v2.1/servers => generated 405 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:13:26.304050 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0774742b-af96-4108-a9b7-f60f320667e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:26.304648 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0774742b-af96-4108-a9b7-f60f320667e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:26.359366 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0774742b-af96-4108-a9b7-f60f320667e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:26.365988 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0774742b-af96-4108-a9b7-f60f320667e0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1093 microversion: 2.1 time: 0.065438 Nov 16 19:13:26.366543 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 485/992] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:26 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:27.385659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-55a251c6-b320-4043-8e77-a8b70452fd60 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:27.386271 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-55a251c6-b320-4043-8e77-a8b70452fd60 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:27.393574 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55a251c6-b320-4043-8e77-a8b70452fd60 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:27.394031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55a251c6-b320-4043-8e77-a8b70452fd60 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:27.394819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55a251c6-b320-4043-8e77-a8b70452fd60 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:27.395439 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55a251c6-b320-4043-8e77-a8b70452fd60 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:27.455663 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55a251c6-b320-4043-8e77-a8b70452fd60 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:27.463986 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-55a251c6-b320-4043-8e77-a8b70452fd60 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1209 microversion: 2.1 time: 0.083109 Nov 16 19:13:27.464634 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 508/993] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:27 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:28.481672 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6e4f5e30-22bd-4cc0-bf7a-7aa8b65cfa4a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:28.482570 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6e4f5e30-22bd-4cc0-bf7a-7aa8b65cfa4a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:28.490099 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6e4f5e30-22bd-4cc0-bf7a-7aa8b65cfa4a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:28.490544 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6e4f5e30-22bd-4cc0-bf7a-7aa8b65cfa4a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:28.491329 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6e4f5e30-22bd-4cc0-bf7a-7aa8b65cfa4a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:28.491749 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6e4f5e30-22bd-4cc0-bf7a-7aa8b65cfa4a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:28.798778 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6e4f5e30-22bd-4cc0-bf7a-7aa8b65cfa4a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:28.806695 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-79097499-fbc9-4162-86e4-86302b5854df req-0b2a64d5-cfb4-40aa-802e-1934d7e3d3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2654762b-4f00-4de9-b1af-e2be569d09c5", "tag": "a30d891d-e171-4453-a208-576a4e39415d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:13:28.808623 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:13:28.808623 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:13:28.812154 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6e4f5e30-22bd-4cc0-bf7a-7aa8b65cfa4a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.332814 Nov 16 19:13:28.820505 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-79097499-fbc9-4162-86e4-86302b5854df req-0b2a64d5-cfb4-40aa-802e-1934d7e3d3da service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:28.820944 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-79097499-fbc9-4162-86e4-86302b5854df req-0b2a64d5-cfb4-40aa-802e-1934d7e3d3da service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:28.827379 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 486/994] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:28 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:28.833268 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-79097499-fbc9-4162-86e4-86302b5854df req-0b2a64d5-cfb4-40aa-802e-1934d7e3d3da service nova] Creating event network-changed:a30d891d-e171-4453-a208-576a4e39415d for instance 2654762b-4f00-4de9-b1af-e2be569d09c5 on hv-cinder-66710 Nov 16 19:13:28.838793 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-79097499-fbc9-4162-86e4-86302b5854df req-0b2a64d5-cfb4-40aa-802e-1934d7e3d3da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036574 Nov 16 19:13:28.839701 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 509/995] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:13:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:13:29.833854 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6b4936e0-b867-41c2-94b6-3f657c2b3c07 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:29.834527 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6b4936e0-b867-41c2-94b6-3f657c2b3c07 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:29.841314 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b4936e0-b867-41c2-94b6-3f657c2b3c07 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:29.841794 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b4936e0-b867-41c2-94b6-3f657c2b3c07 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:29.842557 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b4936e0-b867-41c2-94b6-3f657c2b3c07 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:29.842989 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6b4936e0-b867-41c2-94b6-3f657c2b3c07 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:29.975937 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6b4936e0-b867-41c2-94b6-3f657c2b3c07 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:29.983147 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6b4936e0-b867-41c2-94b6-3f657c2b3c07 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.152972 Nov 16 19:13:29.983699 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 487/996] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:29 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:31.001132 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7a544fd7-033d-4c1f-91e2-6c316996bde9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:31.001842 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7a544fd7-033d-4c1f-91e2-6c316996bde9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:31.008137 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a544fd7-033d-4c1f-91e2-6c316996bde9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:31.008578 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a544fd7-033d-4c1f-91e2-6c316996bde9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:31.009966 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a544fd7-033d-4c1f-91e2-6c316996bde9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:31.010401 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a544fd7-033d-4c1f-91e2-6c316996bde9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:31.142350 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7a544fd7-033d-4c1f-91e2-6c316996bde9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:31.149421 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7a544fd7-033d-4c1f-91e2-6c316996bde9 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.152687 Nov 16 19:13:31.150006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 510/997] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:30 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:32.166646 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-36c7fb86-7ab0-42b7-886b-ee55b893a2a0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:32.167246 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-36c7fb86-7ab0-42b7-886b-ee55b893a2a0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:32.173183 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-36c7fb86-7ab0-42b7-886b-ee55b893a2a0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:32.173656 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-36c7fb86-7ab0-42b7-886b-ee55b893a2a0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:32.174418 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-36c7fb86-7ab0-42b7-886b-ee55b893a2a0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:32.174851 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-36c7fb86-7ab0-42b7-886b-ee55b893a2a0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:32.308336 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-36c7fb86-7ab0-42b7-886b-ee55b893a2a0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:32.315445 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-36c7fb86-7ab0-42b7-886b-ee55b893a2a0 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.153024 Nov 16 19:13:32.316005 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 488/998] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:32 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:33.331689 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d9ff1fa0-abb2-4026-bda2-b0bc54b1a7cc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:33.332272 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d9ff1fa0-abb2-4026-bda2-b0bc54b1a7cc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:33.339061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9ff1fa0-abb2-4026-bda2-b0bc54b1a7cc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:33.339503 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9ff1fa0-abb2-4026-bda2-b0bc54b1a7cc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:33.340263 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9ff1fa0-abb2-4026-bda2-b0bc54b1a7cc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:33.340690 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9ff1fa0-abb2-4026-bda2-b0bc54b1a7cc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:33.469199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d9ff1fa0-abb2-4026-bda2-b0bc54b1a7cc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:33.476388 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d9ff1fa0-abb2-4026-bda2-b0bc54b1a7cc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.148345 Nov 16 19:13:33.476935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 511/999] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:33 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:34.492923 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-410bc3da-7c73-4e76-8626-c35e666af749 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:34.493654 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-410bc3da-7c73-4e76-8626-c35e666af749 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:34.500350 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-410bc3da-7c73-4e76-8626-c35e666af749 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:34.500788 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-410bc3da-7c73-4e76-8626-c35e666af749 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:34.501561 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-410bc3da-7c73-4e76-8626-c35e666af749 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:34.501993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-410bc3da-7c73-4e76-8626-c35e666af749 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:34.631197 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-410bc3da-7c73-4e76-8626-c35e666af749 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:34.638863 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-410bc3da-7c73-4e76-8626-c35e666af749 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.149622 Nov 16 19:13:34.639618 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 489/1000] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:34 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:35.654754 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e06aa68b-a31d-456a-afdd-772399ad15d3 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:35.655344 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e06aa68b-a31d-456a-afdd-772399ad15d3 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:35.661605 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e06aa68b-a31d-456a-afdd-772399ad15d3 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:35.662057 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e06aa68b-a31d-456a-afdd-772399ad15d3 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:35.662829 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e06aa68b-a31d-456a-afdd-772399ad15d3 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:35.663270 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e06aa68b-a31d-456a-afdd-772399ad15d3 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:35.797158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e06aa68b-a31d-456a-afdd-772399ad15d3 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:35.805109 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e06aa68b-a31d-456a-afdd-772399ad15d3 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.154047 Nov 16 19:13:35.805831 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 512/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:35 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:36.822805 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-cd1360b7-5757-4007-ada5-4f918ca7eb3d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:36.823401 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-cd1360b7-5757-4007-ada5-4f918ca7eb3d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:36.829603 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cd1360b7-5757-4007-ada5-4f918ca7eb3d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:36.830050 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cd1360b7-5757-4007-ada5-4f918ca7eb3d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:36.830808 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cd1360b7-5757-4007-ada5-4f918ca7eb3d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:36.831232 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-cd1360b7-5757-4007-ada5-4f918ca7eb3d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:36.963491 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-cd1360b7-5757-4007-ada5-4f918ca7eb3d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:36.970766 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-cd1360b7-5757-4007-ada5-4f918ca7eb3d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.152313 Nov 16 19:13:36.971322 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 490/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:36 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:37.986817 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e6aeab07-3241-4570-b981-1c80d41a89dc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:37.987465 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e6aeab07-3241-4570-b981-1c80d41a89dc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:37.993992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6aeab07-3241-4570-b981-1c80d41a89dc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:37.994439 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6aeab07-3241-4570-b981-1c80d41a89dc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:37.995233 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6aeab07-3241-4570-b981-1c80d41a89dc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:37.995659 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6aeab07-3241-4570-b981-1c80d41a89dc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:38.123680 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e6aeab07-3241-4570-b981-1c80d41a89dc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:38.130996 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e6aeab07-3241-4570-b981-1c80d41a89dc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.147886 Nov 16 19:13:38.131544 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 513/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:37 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:39.147372 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0606bc87-6e16-4bbd-b6d8-a1826a3a07e7 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:39.148031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0606bc87-6e16-4bbd-b6d8-a1826a3a07e7 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:39.154780 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0606bc87-6e16-4bbd-b6d8-a1826a3a07e7 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:39.155220 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0606bc87-6e16-4bbd-b6d8-a1826a3a07e7 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:39.155988 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0606bc87-6e16-4bbd-b6d8-a1826a3a07e7 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:39.156414 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0606bc87-6e16-4bbd-b6d8-a1826a3a07e7 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:39.284075 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-0606bc87-6e16-4bbd-b6d8-a1826a3a07e7 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:39.291851 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0606bc87-6e16-4bbd-b6d8-a1826a3a07e7 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.148205 Nov 16 19:13:39.292424 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 491/1004] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:39 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:39.566647 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-fe3f8cb2-f6cf-43a2-9e1f-749cb791f335 req-2161ab2e-6d68-4667-a52d-c44bdf9860dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2654762b-4f00-4de9-b1af-e2be569d09c5", "name": "network-vif-plugged", "status": "completed", "tag": "a30d891d-e171-4453-a208-576a4e39415d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:13:39.568131 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:13:39.568131 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:13:39.576992 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-fe3f8cb2-f6cf-43a2-9e1f-749cb791f335 req-2161ab2e-6d68-4667-a52d-c44bdf9860dc service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:39.577432 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-fe3f8cb2-f6cf-43a2-9e1f-749cb791f335 req-2161ab2e-6d68-4667-a52d-c44bdf9860dc service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:39.589466 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-fe3f8cb2-f6cf-43a2-9e1f-749cb791f335 req-2161ab2e-6d68-4667-a52d-c44bdf9860dc service nova] Creating event network-vif-plugged:a30d891d-e171-4453-a208-576a4e39415d for instance 2654762b-4f00-4de9-b1af-e2be569d09c5 on hv-cinder-66710 Nov 16 19:13:39.594111 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-fe3f8cb2-f6cf-43a2-9e1f-749cb791f335 req-2161ab2e-6d68-4667-a52d-c44bdf9860dc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031619 Nov 16 19:13:39.594891 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 514/1005] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:13:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:13:40.308498 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5f06f475-fba6-4768-a052-a42c98eaf85f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:40.309087 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5f06f475-fba6-4768-a052-a42c98eaf85f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:40.315323 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5f06f475-fba6-4768-a052-a42c98eaf85f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:40.315765 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5f06f475-fba6-4768-a052-a42c98eaf85f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:40.316520 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5f06f475-fba6-4768-a052-a42c98eaf85f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:40.316951 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5f06f475-fba6-4768-a052-a42c98eaf85f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:40.455344 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5f06f475-fba6-4768-a052-a42c98eaf85f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:40.462576 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5f06f475-fba6-4768-a052-a42c98eaf85f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1264 microversion: 2.1 time: 0.157804 Nov 16 19:13:40.463662 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 492/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:40 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:41.480508 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0e66ccf7-a6e5-4ba3-aa9b-fc1255aa348a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:41.481201 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0e66ccf7-a6e5-4ba3-aa9b-fc1255aa348a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:41.487666 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e66ccf7-a6e5-4ba3-aa9b-fc1255aa348a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:41.488114 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e66ccf7-a6e5-4ba3-aa9b-fc1255aa348a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:41.488882 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e66ccf7-a6e5-4ba3-aa9b-fc1255aa348a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:41.489310 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e66ccf7-a6e5-4ba3-aa9b-fc1255aa348a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:41.621455 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0e66ccf7-a6e5-4ba3-aa9b-fc1255aa348a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:41.629114 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0e66ccf7-a6e5-4ba3-aa9b-fc1255aa348a tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1451 microversion: 2.1 time: 0.152904 Nov 16 19:13:41.629692 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 515/1007] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:41 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:13:41.645224 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-d2049971-1658-4272-b28b-e96a3881956f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:13:41.646437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-d2049971-1658-4272-b28b-e96a3881956f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:13:41.653103 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d2049971-1658-4272-b28b-e96a3881956f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:41.653565 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d2049971-1658-4272-b28b-e96a3881956f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:41.654339 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d2049971-1658-4272-b28b-e96a3881956f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:41.654769 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-d2049971-1658-4272-b28b-e96a3881956f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:41.851798 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-d2049971-1658-4272-b28b-e96a3881956f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:13:41.859755 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-d2049971-1658-4272-b28b-e96a3881956f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1451 microversion: 2.1 time: 0.218133 Nov 16 19:13:41.860318 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 493/1008] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:13:41 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1451 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:13:43.414656 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-dd8a6ab0-b99c-40f4-9adb-84295b981b09 req-eb6ee21a-16a6-4d6d-8ad5-7a318997a982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2654762b-4f00-4de9-b1af-e2be569d09c5", "tag": "a30d891d-e171-4453-a208-576a4e39415d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:13:43.416205 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:13:43.416205 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:13:43.423532 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-dd8a6ab0-b99c-40f4-9adb-84295b981b09 req-eb6ee21a-16a6-4d6d-8ad5-7a318997a982 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:13:43.423972 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-dd8a6ab0-b99c-40f4-9adb-84295b981b09 req-eb6ee21a-16a6-4d6d-8ad5-7a318997a982 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:13:43.434506 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-dd8a6ab0-b99c-40f4-9adb-84295b981b09 req-eb6ee21a-16a6-4d6d-8ad5-7a318997a982 service nova] Creating event network-changed:a30d891d-e171-4453-a208-576a4e39415d for instance 2654762b-4f00-4de9-b1af-e2be569d09c5 on hv-cinder-66710 Nov 16 19:13:43.439325 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-dd8a6ab0-b99c-40f4-9adb-84295b981b09 req-eb6ee21a-16a6-4d6d-8ad5-7a318997a982 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028458 Nov 16 19:13:43.439902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 516/1009] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:13:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:15:09.512816 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b2eabb4b-4448-42ee-aa9c-2f11d9246eae] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 16 19:15:09.516515 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-52bf6742-a847-478f-af52-b70c22b9b37e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:15:09.517031 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-52bf6742-a847-478f-af52-b70c22b9b37e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:09.522913 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-52bf6742-a847-478f-af52-b70c22b9b37e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:09.523354 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-52bf6742-a847-478f-af52-b70c22b9b37e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:09.524113 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-52bf6742-a847-478f-af52-b70c22b9b37e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:09.524542 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-52bf6742-a847-478f-af52-b70c22b9b37e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:09.546405 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-52bf6742-a847-478f-af52-b70c22b9b37e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lazy-loading 'flavor' on Instance uuid 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:15:09.616837 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-52bf6742-a847-478f-af52-b70c22b9b37e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "POST /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811/action" status: 202 len: 0 microversion: 2.1 time: 0.105533 Nov 16 19:15:09.617333 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 494/1010] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:15:09 2021] POST /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:15:09.627366 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b73d3828-f6e1-48c0-a125-57fe54e67ae5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:09.628064 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b73d3828-f6e1-48c0-a125-57fe54e67ae5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:09.634498 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b73d3828-f6e1-48c0-a125-57fe54e67ae5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:09.634970 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b73d3828-f6e1-48c0-a125-57fe54e67ae5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:09.635818 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b73d3828-f6e1-48c0-a125-57fe54e67ae5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:09.636354 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b73d3828-f6e1-48c0-a125-57fe54e67ae5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:09.768322 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b73d3828-f6e1-48c0-a125-57fe54e67ae5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:09.775674 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b73d3828-f6e1-48c0-a125-57fe54e67ae5 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.153821 Nov 16 19:15:09.776229 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 517/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:09 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:10.805337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-fafbf0b0-467b-457c-b27d-d9bfda940d54 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:10.806054 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-fafbf0b0-467b-457c-b27d-d9bfda940d54 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:10.813668 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fafbf0b0-467b-457c-b27d-d9bfda940d54 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:10.814117 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fafbf0b0-467b-457c-b27d-d9bfda940d54 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:10.814916 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fafbf0b0-467b-457c-b27d-d9bfda940d54 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:10.815346 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-fafbf0b0-467b-457c-b27d-d9bfda940d54 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:10.820554 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO oslo.messaging._drivers.impl_rabbit [-] [b2eabb4b-4448-42ee-aa9c-2f11d9246eae] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41230. Nov 16 19:15:10.945397 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-fafbf0b0-467b-457c-b27d-d9bfda940d54 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:10.953128 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-fafbf0b0-467b-457c-b27d-d9bfda940d54 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.162047 Nov 16 19:15:10.953709 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 495/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:10 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:11.970176 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d055e55e-0afa-4ab8-a011-2eac0bb1a5aa tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:11.970817 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d055e55e-0afa-4ab8-a011-2eac0bb1a5aa tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:11.977464 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d055e55e-0afa-4ab8-a011-2eac0bb1a5aa tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:11.977940 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d055e55e-0afa-4ab8-a011-2eac0bb1a5aa tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:11.978726 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d055e55e-0afa-4ab8-a011-2eac0bb1a5aa tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:11.979159 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d055e55e-0afa-4ab8-a011-2eac0bb1a5aa tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:12.113835 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d055e55e-0afa-4ab8-a011-2eac0bb1a5aa tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:12.121127 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d055e55e-0afa-4ab8-a011-2eac0bb1a5aa tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.154732 Nov 16 19:15:12.121707 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 518/1013] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:11 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:13.138563 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c2971ad8-3fa9-4e75-a5d6-efe5f1541663 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:13.139247 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c2971ad8-3fa9-4e75-a5d6-efe5f1541663 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:13.145395 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c2971ad8-3fa9-4e75-a5d6-efe5f1541663 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:13.145868 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c2971ad8-3fa9-4e75-a5d6-efe5f1541663 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:13.146630 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c2971ad8-3fa9-4e75-a5d6-efe5f1541663 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:13.147052 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c2971ad8-3fa9-4e75-a5d6-efe5f1541663 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:13.283437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c2971ad8-3fa9-4e75-a5d6-efe5f1541663 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:13.290674 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c2971ad8-3fa9-4e75-a5d6-efe5f1541663 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.155750 Nov 16 19:15:13.291230 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 496/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:13 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:14.307894 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b937665c-8666-49fb-baa5-a8ddcc8fbb4f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:14.308501 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b937665c-8666-49fb-baa5-a8ddcc8fbb4f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:14.316576 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b937665c-8666-49fb-baa5-a8ddcc8fbb4f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:14.316576 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b937665c-8666-49fb-baa5-a8ddcc8fbb4f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:14.316576 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b937665c-8666-49fb-baa5-a8ddcc8fbb4f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:14.316576 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b937665c-8666-49fb-baa5-a8ddcc8fbb4f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:14.446598 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b937665c-8666-49fb-baa5-a8ddcc8fbb4f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:14.454006 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b937665c-8666-49fb-baa5-a8ddcc8fbb4f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.149589 Nov 16 19:15:14.454417 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 519/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:14 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:15.471206 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-5311889f-8968-4074-972f-73b16fa6f06b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:15.471801 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-5311889f-8968-4074-972f-73b16fa6f06b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:15.478165 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5311889f-8968-4074-972f-73b16fa6f06b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:15.478590 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5311889f-8968-4074-972f-73b16fa6f06b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:15.479357 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5311889f-8968-4074-972f-73b16fa6f06b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:15.479773 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-5311889f-8968-4074-972f-73b16fa6f06b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:15.766508 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-5311889f-8968-4074-972f-73b16fa6f06b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:15.773781 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-5311889f-8968-4074-972f-73b16fa6f06b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.306207 Nov 16 19:15:15.774328 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 497/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:15 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:16.791090 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cd595f7c-38b7-4e77-8fc2-89b68afe42ec tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:16.791726 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cd595f7c-38b7-4e77-8fc2-89b68afe42ec tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:16.798516 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cd595f7c-38b7-4e77-8fc2-89b68afe42ec tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:16.798964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cd595f7c-38b7-4e77-8fc2-89b68afe42ec tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:16.799741 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cd595f7c-38b7-4e77-8fc2-89b68afe42ec tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:16.800174 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cd595f7c-38b7-4e77-8fc2-89b68afe42ec tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:16.928171 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cd595f7c-38b7-4e77-8fc2-89b68afe42ec tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:16.935400 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cd595f7c-38b7-4e77-8fc2-89b68afe42ec tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.148019 Nov 16 19:15:16.935964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 520/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:16 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:17.953575 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a4440680-5cc7-4363-aaa7-ba695854b9a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:17.954177 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a4440680-5cc7-4363-aaa7-ba695854b9a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:17.960421 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a4440680-5cc7-4363-aaa7-ba695854b9a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:17.960865 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a4440680-5cc7-4363-aaa7-ba695854b9a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:17.961655 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a4440680-5cc7-4363-aaa7-ba695854b9a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:17.962090 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a4440680-5cc7-4363-aaa7-ba695854b9a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:18.089753 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a4440680-5cc7-4363-aaa7-ba695854b9a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:18.096967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a4440680-5cc7-4363-aaa7-ba695854b9a8 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.147663 Nov 16 19:15:18.097512 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 498/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:17 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:19.113350 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d5d2eece-2f1e-4fda-b3da-306628e03768 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:19.114035 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d5d2eece-2f1e-4fda-b3da-306628e03768 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:19.120243 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5d2eece-2f1e-4fda-b3da-306628e03768 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:19.120678 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5d2eece-2f1e-4fda-b3da-306628e03768 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:19.121439 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5d2eece-2f1e-4fda-b3da-306628e03768 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:19.121897 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5d2eece-2f1e-4fda-b3da-306628e03768 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:19.256268 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d5d2eece-2f1e-4fda-b3da-306628e03768 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:19.263807 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d5d2eece-2f1e-4fda-b3da-306628e03768 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.154096 Nov 16 19:15:19.264355 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 521/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:19 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:20.281387 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6fb69a78-f6e4-4200-b180-e40d3f3f604f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:20.282021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6fb69a78-f6e4-4200-b180-e40d3f3f604f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:20.288218 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6fb69a78-f6e4-4200-b180-e40d3f3f604f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:20.288658 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6fb69a78-f6e4-4200-b180-e40d3f3f604f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:20.289422 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6fb69a78-f6e4-4200-b180-e40d3f3f604f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:20.289878 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6fb69a78-f6e4-4200-b180-e40d3f3f604f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:20.434631 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6fb69a78-f6e4-4200-b180-e40d3f3f604f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:20.442424 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6fb69a78-f6e4-4200-b180-e40d3f3f604f tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.164669 Nov 16 19:15:20.442978 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 499/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:20 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:21.459527 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-db03e3d0-65e7-48b4-846b-9bc6f85dcf71 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:21.460128 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-db03e3d0-65e7-48b4-846b-9bc6f85dcf71 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:21.466374 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db03e3d0-65e7-48b4-846b-9bc6f85dcf71 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:21.466849 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db03e3d0-65e7-48b4-846b-9bc6f85dcf71 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:21.467620 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db03e3d0-65e7-48b4-846b-9bc6f85dcf71 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:21.468052 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db03e3d0-65e7-48b4-846b-9bc6f85dcf71 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:21.595703 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-db03e3d0-65e7-48b4-846b-9bc6f85dcf71 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:21.602877 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-db03e3d0-65e7-48b4-846b-9bc6f85dcf71 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.147031 Nov 16 19:15:21.603428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 522/1021] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:21 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:22.620367 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ddbbb79a-bacf-4aac-9160-325e72e90169 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:22.620885 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ddbbb79a-bacf-4aac-9160-325e72e90169 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:22.628133 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ddbbb79a-bacf-4aac-9160-325e72e90169 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:22.628592 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ddbbb79a-bacf-4aac-9160-325e72e90169 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:22.629371 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ddbbb79a-bacf-4aac-9160-325e72e90169 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:22.629842 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ddbbb79a-bacf-4aac-9160-325e72e90169 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:22.765965 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ddbbb79a-bacf-4aac-9160-325e72e90169 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:22.774219 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ddbbb79a-bacf-4aac-9160-325e72e90169 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.157717 Nov 16 19:15:22.774835 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 500/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:22 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:23.225903 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-158145463", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-376292854", "security_groups": [{"name": "tempest-secgroup-smoke-470136781"}], "block_device_mapping_v2": [{"uuid": "5c8b2cb2-6199-4ed1-960c-7dc16069aee5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8869448c-a462-4b3c-b5fc-a38ebbecc48e"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:15:23.331566 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] validate_networks() for [('8869448c-a462-4b3c-b5fc-a38ebbecc48e', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 19:15:23.766281 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 19:15:23.766705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 19:15:23.767201 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 19:15:23.767610 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 19:15:23.768048 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 19:15:23.776412 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:23.776857 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:23.777698 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:23.778131 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:23.791652 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-ec0479b6-d607-4084-9d1e-b194cf99803b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:23.792255 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-ec0479b6-d607-4084-9d1e-b194cf99803b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:23.794963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for project ffaa0849f50740c491e5f247362c3b10. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 19:15:23.798639 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ec0479b6-d607-4084-9d1e-b194cf99803b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:23.798967 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Getting quotas for user 99e8dcf6fbda47a0b243239f62720c4a and project ffaa0849f50740c491e5f247362c3b10. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 19:15:23.799119 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ec0479b6-d607-4084-9d1e-b194cf99803b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:23.799845 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ec0479b6-d607-4084-9d1e-b194cf99803b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:23.800302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-ec0479b6-d607-4084-9d1e-b194cf99803b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:23.853383 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 19:15:23.855595 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5c8b2cb2-6199-4ed1-960c-7dc16069aee5',volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 19:15:23.934644 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-ec0479b6-d607-4084-9d1e-b194cf99803b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:23.942723 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-ec0479b6-d607-4084-9d1e-b194cf99803b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1510 microversion: 2.1 time: 0.154717 Nov 16 19:15:23.943276 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 501/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:23 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:23.959270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-2dfc67ca-65cd-44c6-bb2d-c32b9817493e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:15:23.959830 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-2dfc67ca-65cd-44c6-bb2d-c32b9817493e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:23.966111 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ca-65cd-44c6-bb2d-c32b9817493e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:23.966560 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ca-65cd-44c6-bb2d-c32b9817493e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:23.967331 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ca-65cd-44c6-bb2d-c32b9817493e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:23.967766 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-2dfc67ca-65cd-44c6-bb2d-c32b9817493e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:23.978932 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a99ddb59-7344-4faf-b711-c71f20261667 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756585 Nov 16 19:15:23.979712 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 523/1024] 10.222.0.46 () {60 vars in 1146 bytes} [Tue Nov 16 19:15:23 2021] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 19:15:23.990134 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fd1f9b08-766b-4e73-ae8f-1c1c2388651f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:23.990734 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fd1f9b08-766b-4e73-ae8f-1c1c2388651f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:24.047124 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-2dfc67ca-65cd-44c6-bb2d-c32b9817493e tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "POST /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811/action" status: 202 len: 0 microversion: 2.1 time: 0.090369 Nov 16 19:15:24.047749 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 502/1025] 10.222.0.46 () {60 vars in 1277 bytes} [Tue Nov 16 19:15:23 2021] POST /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 19:15:24.049664 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fd1f9b08-766b-4e73-ae8f-1c1c2388651f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:24.056959 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7faf5e30-92db-436e-a789-0621777819c6 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:24.057128 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fd1f9b08-766b-4e73-ae8f-1c1c2388651f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1093 microversion: 2.1 time: 0.070272 Nov 16 19:15:24.058201 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7faf5e30-92db-436e-a789-0621777819c6 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:24.064389 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 524/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:23 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:24.068023 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7faf5e30-92db-436e-a789-0621777819c6 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:24.068633 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7faf5e30-92db-436e-a789-0621777819c6 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:24.069579 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7faf5e30-92db-436e-a789-0621777819c6 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:24.069993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7faf5e30-92db-436e-a789-0621777819c6 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:24.219961 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7faf5e30-92db-436e-a789-0621777819c6 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:24.228175 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7faf5e30-92db-436e-a789-0621777819c6 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1518 microversion: 2.1 time: 0.175740 Nov 16 19:15:24.228912 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 503/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:24 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:25.073567 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-702c420d-be87-4cc7-bc72-8f5f1cdc346d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:25.074180 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-702c420d-be87-4cc7-bc72-8f5f1cdc346d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:25.080988 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-702c420d-be87-4cc7-bc72-8f5f1cdc346d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:25.081427 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-702c420d-be87-4cc7-bc72-8f5f1cdc346d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:25.082386 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-702c420d-be87-4cc7-bc72-8f5f1cdc346d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:25.082656 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-702c420d-be87-4cc7-bc72-8f5f1cdc346d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:25.154031 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-702c420d-be87-4cc7-bc72-8f5f1cdc346d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:25.163158 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-702c420d-be87-4cc7-bc72-8f5f1cdc346d tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1209 microversion: 2.1 time: 0.093181 Nov 16 19:15:25.164041 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 525/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:25 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:25.245775 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-a1c7df00-87d2-45e8-9909-600c8590c613 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:25.246396 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-a1c7df00-87d2-45e8-9909-600c8590c613 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:25.252365 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a1c7df00-87d2-45e8-9909-600c8590c613 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:25.252817 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a1c7df00-87d2-45e8-9909-600c8590c613 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:25.253628 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a1c7df00-87d2-45e8-9909-600c8590c613 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:25.254065 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-a1c7df00-87d2-45e8-9909-600c8590c613 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:25.473483 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-a1c7df00-87d2-45e8-9909-600c8590c613 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:25.481246 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-a1c7df00-87d2-45e8-9909-600c8590c613 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1576 microversion: 2.1 time: 0.239657 Nov 16 19:15:25.481843 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 504/1029] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:25 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:26.102800 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-6cb4d784-c38e-42c8-9cf4-63616a282ae1 req-fcdcf12f-beb9-4c9e-851b-e4b21c363550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811", "name": "network-vif-unplugged", "status": "completed", "tag": "09ee89b4-ca67-46d8-a2ca-e497e063a615"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:15:26.104379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:15:26.104379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:15:26.112390 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-6cb4d784-c38e-42c8-9cf4-63616a282ae1 req-fcdcf12f-beb9-4c9e-851b-e4b21c363550 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:26.112832 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-6cb4d784-c38e-42c8-9cf4-63616a282ae1 req-fcdcf12f-beb9-4c9e-851b-e4b21c363550 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:26.123643 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-6cb4d784-c38e-42c8-9cf4-63616a282ae1 req-fcdcf12f-beb9-4c9e-851b-e4b21c363550 service nova] Creating event network-vif-unplugged:09ee89b4-ca67-46d8-a2ca-e497e063a615 for instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 on hv-cinder-66710 Nov 16 19:15:26.130733 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-6cb4d784-c38e-42c8-9cf4-63616a282ae1 req-fcdcf12f-beb9-4c9e-851b-e4b21c363550 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031481 Nov 16 19:15:26.131872 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 526/1030] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:15:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:15:26.180864 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-77711c1b-8a55-4761-bcb8-7d81d6ef8ee2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:26.181465 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-77711c1b-8a55-4761-bcb8-7d81d6ef8ee2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:26.188658 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-77711c1b-8a55-4761-bcb8-7d81d6ef8ee2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:26.189175 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-77711c1b-8a55-4761-bcb8-7d81d6ef8ee2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:26.190073 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-77711c1b-8a55-4761-bcb8-7d81d6ef8ee2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:26.191287 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-77711c1b-8a55-4761-bcb8-7d81d6ef8ee2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:26.499199 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c3e95af3-5b97-4db5-a2ca-56846dc94889 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:26.499886 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c3e95af3-5b97-4db5-a2ca-56846dc94889 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:26.506310 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c3e95af3-5b97-4db5-a2ca-56846dc94889 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:26.506766 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c3e95af3-5b97-4db5-a2ca-56846dc94889 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:26.507803 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c3e95af3-5b97-4db5-a2ca-56846dc94889 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:26.508240 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c3e95af3-5b97-4db5-a2ca-56846dc94889 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:26.642410 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c3e95af3-5b97-4db5-a2ca-56846dc94889 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:26.650236 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c3e95af3-5b97-4db5-a2ca-56846dc94889 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1576 microversion: 2.1 time: 0.155000 Nov 16 19:15:26.650798 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 527/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:26 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:26.764369 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-77711c1b-8a55-4761-bcb8-7d81d6ef8ee2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:26.772701 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-77711c1b-8a55-4761-bcb8-7d81d6ef8ee2 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.596269 Nov 16 19:15:26.773270 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 505/1032] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:26 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:27.048159 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-a8af426c-315f-4dab-8fee-d6543b110309 req-cb389c21-99f6-43f0-b9e4-94bb981b9c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe776799-5aba-4894-a1c3-35f96f710982", "tag": "b8d27769-cb89-48e8-829c-d3246940d9f3"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:15:27.050213 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:15:27.050213 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:15:27.058428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-a8af426c-315f-4dab-8fee-d6543b110309 req-cb389c21-99f6-43f0-b9e4-94bb981b9c89 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:27.059406 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-a8af426c-315f-4dab-8fee-d6543b110309 req-cb389c21-99f6-43f0-b9e4-94bb981b9c89 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:27.076330 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-a8af426c-315f-4dab-8fee-d6543b110309 req-cb389c21-99f6-43f0-b9e4-94bb981b9c89 service nova] Creating event network-changed:b8d27769-cb89-48e8-829c-d3246940d9f3 for instance fe776799-5aba-4894-a1c3-35f96f710982 on hv-cinder-66710 Nov 16 19:15:27.081698 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-a8af426c-315f-4dab-8fee-d6543b110309 req-cb389c21-99f6-43f0-b9e4-94bb981b9c89 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040431 Nov 16 19:15:27.082168 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 528/1033] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:15:27.667804 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-84386766-b819-4397-8a32-1cb4faddf604 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:27.668533 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-84386766-b819-4397-8a32-1cb4faddf604 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:27.675656 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-84386766-b819-4397-8a32-1cb4faddf604 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:27.676103 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-84386766-b819-4397-8a32-1cb4faddf604 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:27.676875 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-84386766-b819-4397-8a32-1cb4faddf604 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:27.677313 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-84386766-b819-4397-8a32-1cb4faddf604 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:27.791079 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d8d9feef-661d-4711-ac16-18a7544fd3af tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:27.791909 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d8d9feef-661d-4711-ac16-18a7544fd3af tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:27.798669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8d9feef-661d-4711-ac16-18a7544fd3af tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:27.799115 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8d9feef-661d-4711-ac16-18a7544fd3af tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:27.799885 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8d9feef-661d-4711-ac16-18a7544fd3af tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:27.800314 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8d9feef-661d-4711-ac16-18a7544fd3af tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:27.873351 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-84386766-b819-4397-8a32-1cb4faddf604 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:27.881356 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-84386766-b819-4397-8a32-1cb4faddf604 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1576 microversion: 2.1 time: 0.217191 Nov 16 19:15:27.882562 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 506/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:27 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:27.937178 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d8d9feef-661d-4711-ac16-18a7544fd3af tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:27.944379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d8d9feef-661d-4711-ac16-18a7544fd3af tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.157748 Nov 16 19:15:27.944939 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 529/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:27 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:28.898841 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-b2bc26ab-b148-48a2-866e-6c248e2dc783 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:28.899418 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-b2bc26ab-b148-48a2-866e-6c248e2dc783 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:28.906352 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b2bc26ab-b148-48a2-866e-6c248e2dc783 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:28.906793 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b2bc26ab-b148-48a2-866e-6c248e2dc783 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:28.907554 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b2bc26ab-b148-48a2-866e-6c248e2dc783 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:28.907975 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-b2bc26ab-b148-48a2-866e-6c248e2dc783 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:28.961147 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-01d12149-9b81-43a6-93c7-76296a215853 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:28.962007 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-01d12149-9b81-43a6-93c7-76296a215853 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:28.967902 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01d12149-9b81-43a6-93c7-76296a215853 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:28.968964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01d12149-9b81-43a6-93c7-76296a215853 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:28.969857 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01d12149-9b81-43a6-93c7-76296a215853 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:28.970361 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01d12149-9b81-43a6-93c7-76296a215853 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:29.039466 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-b2bc26ab-b148-48a2-866e-6c248e2dc783 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:29.047436 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-b2bc26ab-b148-48a2-866e-6c248e2dc783 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1576 microversion: 2.1 time: 0.152268 Nov 16 19:15:29.048350 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 507/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:28 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:29.099681 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-01d12149-9b81-43a6-93c7-76296a215853 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:29.106889 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-01d12149-9b81-43a6-93c7-76296a215853 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.149537 Nov 16 19:15:29.107442 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 530/1037] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:28 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:30.064974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-7e09cff4-791b-4f6b-8c08-86eb7ea27e47 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:30.065603 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-7e09cff4-791b-4f6b-8c08-86eb7ea27e47 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:30.071987 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7e09cff4-791b-4f6b-8c08-86eb7ea27e47 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:30.072437 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7e09cff4-791b-4f6b-8c08-86eb7ea27e47 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:30.073214 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7e09cff4-791b-4f6b-8c08-86eb7ea27e47 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:30.073716 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-7e09cff4-791b-4f6b-8c08-86eb7ea27e47 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:30.123326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4461fc8a-acc8-432f-b14d-26ad30f03b1f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:30.123958 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4461fc8a-acc8-432f-b14d-26ad30f03b1f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:30.130707 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4461fc8a-acc8-432f-b14d-26ad30f03b1f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:30.131163 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4461fc8a-acc8-432f-b14d-26ad30f03b1f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:30.131942 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4461fc8a-acc8-432f-b14d-26ad30f03b1f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:30.132634 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4461fc8a-acc8-432f-b14d-26ad30f03b1f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:30.207009 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-7e09cff4-791b-4f6b-8c08-86eb7ea27e47 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:30.214546 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-7e09cff4-791b-4f6b-8c08-86eb7ea27e47 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1576 microversion: 2.1 time: 0.153712 Nov 16 19:15:30.215134 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 508/1038] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:30 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:30.265750 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4461fc8a-acc8-432f-b14d-26ad30f03b1f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:30.273565 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4461fc8a-acc8-432f-b14d-26ad30f03b1f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.153814 Nov 16 19:15:30.274131 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 531/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:30 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:31.231042 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c1b4cdc7-bb97-4e34-b47e-7baa0d0cbd97 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:31.231649 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-c1b4cdc7-bb97-4e34-b47e-7baa0d0cbd97 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:31.238408 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c1b4cdc7-bb97-4e34-b47e-7baa0d0cbd97 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:31.238861 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c1b4cdc7-bb97-4e34-b47e-7baa0d0cbd97 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:31.239630 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c1b4cdc7-bb97-4e34-b47e-7baa0d0cbd97 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:31.240062 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-c1b4cdc7-bb97-4e34-b47e-7baa0d0cbd97 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:31.290206 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7aa8448d-e256-4850-9e9e-a6622b0a558c tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:31.290814 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7aa8448d-e256-4850-9e9e-a6622b0a558c tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:31.297804 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7aa8448d-e256-4850-9e9e-a6622b0a558c tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:31.298252 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7aa8448d-e256-4850-9e9e-a6622b0a558c tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:31.299025 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7aa8448d-e256-4850-9e9e-a6622b0a558c tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:31.299458 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7aa8448d-e256-4850-9e9e-a6622b0a558c tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:31.372077 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-c1b4cdc7-bb97-4e34-b47e-7baa0d0cbd97 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:31.380045 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c1b4cdc7-bb97-4e34-b47e-7baa0d0cbd97 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1576 microversion: 2.1 time: 0.152632 Nov 16 19:15:31.380612 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 509/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:31 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:31.432643 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7aa8448d-e256-4850-9e9e-a6622b0a558c tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:31.439978 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7aa8448d-e256-4850-9e9e-a6622b0a558c tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.153434 Nov 16 19:15:31.440537 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 532/1041] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:31 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:32.398812 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-218e998f-6cd2-4cbb-b1e7-eb1ef8f1682b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:32.399416 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-218e998f-6cd2-4cbb-b1e7-eb1ef8f1682b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:32.405577 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-218e998f-6cd2-4cbb-b1e7-eb1ef8f1682b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:32.406021 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-218e998f-6cd2-4cbb-b1e7-eb1ef8f1682b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:32.406778 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-218e998f-6cd2-4cbb-b1e7-eb1ef8f1682b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:32.407204 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-218e998f-6cd2-4cbb-b1e7-eb1ef8f1682b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:32.456823 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7af489ed-c3d6-4897-938e-b8cf237fadee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:32.457419 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7af489ed-c3d6-4897-938e-b8cf237fadee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:32.463841 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7af489ed-c3d6-4897-938e-b8cf237fadee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:32.464235 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7af489ed-c3d6-4897-938e-b8cf237fadee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:32.464925 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7af489ed-c3d6-4897-938e-b8cf237fadee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:32.465353 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7af489ed-c3d6-4897-938e-b8cf237fadee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:32.538103 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-218e998f-6cd2-4cbb-b1e7-eb1ef8f1682b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:32.545376 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-218e998f-6cd2-4cbb-b1e7-eb1ef8f1682b tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1576 microversion: 2.1 time: 0.150195 Nov 16 19:15:32.546502 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 510/1042] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:32 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:32.600210 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7af489ed-c3d6-4897-938e-b8cf237fadee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:32.607505 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7af489ed-c3d6-4897-938e-b8cf237fadee tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.154810 Nov 16 19:15:32.608049 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 533/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:32 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:33.565465 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-edd4f942-f4c3-48b1-88b4-cb87f7b55a73 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:33.566096 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-edd4f942-f4c3-48b1-88b4-cb87f7b55a73 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:33.572362 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-edd4f942-f4c3-48b1-88b4-cb87f7b55a73 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:33.572813 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-edd4f942-f4c3-48b1-88b4-cb87f7b55a73 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:33.573613 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-edd4f942-f4c3-48b1-88b4-cb87f7b55a73 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:33.574046 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-edd4f942-f4c3-48b1-88b4-cb87f7b55a73 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:33.625101 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b0905d0d-2a30-4390-a3c2-079c1b2c227e tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:33.625747 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b0905d0d-2a30-4390-a3c2-079c1b2c227e tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:33.631916 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0905d0d-2a30-4390-a3c2-079c1b2c227e tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:33.632619 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0905d0d-2a30-4390-a3c2-079c1b2c227e tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:33.633391 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0905d0d-2a30-4390-a3c2-079c1b2c227e tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:33.633856 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0905d0d-2a30-4390-a3c2-079c1b2c227e tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:33.703447 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-edd4f942-f4c3-48b1-88b4-cb87f7b55a73 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:33.710867 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-edd4f942-f4c3-48b1-88b4-cb87f7b55a73 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1576 microversion: 2.1 time: 0.149402 Nov 16 19:15:33.711243 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 511/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:33 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:33.762680 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b0905d0d-2a30-4390-a3c2-079c1b2c227e tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:33.769756 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b0905d0d-2a30-4390-a3c2-079c1b2c227e tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.148892 Nov 16 19:15:33.770308 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 534/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:33 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:34.727882 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-4b4dd419-d078-4ae9-a036-f3d9cb48cd2a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:34.728491 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-4b4dd419-d078-4ae9-a036-f3d9cb48cd2a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:34.735243 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b4dd419-d078-4ae9-a036-f3d9cb48cd2a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:34.735691 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b4dd419-d078-4ae9-a036-f3d9cb48cd2a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:34.736462 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b4dd419-d078-4ae9-a036-f3d9cb48cd2a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:34.736897 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-4b4dd419-d078-4ae9-a036-f3d9cb48cd2a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:34.786867 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7dc35b3b-1154-4910-9bf0-25ecea732fa8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:34.787472 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7dc35b3b-1154-4910-9bf0-25ecea732fa8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:34.793786 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dc35b3b-1154-4910-9bf0-25ecea732fa8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:34.794238 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dc35b3b-1154-4910-9bf0-25ecea732fa8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:34.795016 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dc35b3b-1154-4910-9bf0-25ecea732fa8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:34.795554 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7dc35b3b-1154-4910-9bf0-25ecea732fa8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:34.869770 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-4b4dd419-d078-4ae9-a036-f3d9cb48cd2a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:34.877010 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-4b4dd419-d078-4ae9-a036-f3d9cb48cd2a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1563 microversion: 2.1 time: 0.152798 Nov 16 19:15:34.877581 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 512/1046] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:34 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:34.926274 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7dc35b3b-1154-4910-9bf0-25ecea732fa8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:34.933379 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7dc35b3b-1154-4910-9bf0-25ecea732fa8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.150199 Nov 16 19:15:34.933964 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 535/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:34 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 19:15:35.950658 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-bb82f117-4d30-4b86-a631-cc94944cea94 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:35.951401 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-bb82f117-4d30-4b86-a631-cc94944cea94 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:35.957825 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bb82f117-4d30-4b86-a631-cc94944cea94 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:35.958355 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bb82f117-4d30-4b86-a631-cc94944cea94 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:35.959131 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bb82f117-4d30-4b86-a631-cc94944cea94 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:35.959560 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-bb82f117-4d30-4b86-a631-cc94944cea94 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:36.088036 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-bb82f117-4d30-4b86-a631-cc94944cea94 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:36.095736 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-bb82f117-4d30-4b86-a631-cc94944cea94 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.149390 Nov 16 19:15:36.096300 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 513/1048] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:35 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:36.417185 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-0dd994c2-efea-4df8-aa15-fc625d8b032c req-a668f5d0-82a3-4487-a694-775561c7b5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811", "name": "network-vif-plugged", "status": "completed", "tag": "09ee89b4-ca67-46d8-a2ca-e497e063a615"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:15:36.418709 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:15:36.418709 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:15:36.425359 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-0dd994c2-efea-4df8-aa15-fc625d8b032c req-a668f5d0-82a3-4487-a694-775561c7b5a5 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:36.425828 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-0dd994c2-efea-4df8-aa15-fc625d8b032c req-a668f5d0-82a3-4487-a694-775561c7b5a5 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:36.436716 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-0dd994c2-efea-4df8-aa15-fc625d8b032c req-a668f5d0-82a3-4487-a694-775561c7b5a5 service nova] Creating event network-vif-plugged:09ee89b4-ca67-46d8-a2ca-e497e063a615 for instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 on hv-cinder-66710 Nov 16 19:15:36.441845 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-0dd994c2-efea-4df8-aa15-fc625d8b032c req-a668f5d0-82a3-4487-a694-775561c7b5a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028890 Nov 16 19:15:36.442422 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 536/1049] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:15:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:15:37.111967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-1aee5ded-505d-4164-bf40-9b4af3a77ddc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:37.112527 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-1aee5ded-505d-4164-bf40-9b4af3a77ddc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:37.118771 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1aee5ded-505d-4164-bf40-9b4af3a77ddc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:37.119156 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1aee5ded-505d-4164-bf40-9b4af3a77ddc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:37.119911 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1aee5ded-505d-4164-bf40-9b4af3a77ddc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:37.120335 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-1aee5ded-505d-4164-bf40-9b4af3a77ddc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:37.247645 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-1aee5ded-505d-4164-bf40-9b4af3a77ddc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:37.255421 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-1aee5ded-505d-4164-bf40-9b4af3a77ddc tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.147662 Nov 16 19:15:37.255974 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 514/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:37 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:38.272969 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5362be2e-c983-47ed-9773-c95b0d2b9949 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:38.273625 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5362be2e-c983-47ed-9773-c95b0d2b9949 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:38.279616 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5362be2e-c983-47ed-9773-c95b0d2b9949 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:38.280061 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5362be2e-c983-47ed-9773-c95b0d2b9949 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:38.281326 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5362be2e-c983-47ed-9773-c95b0d2b9949 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:38.281783 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5362be2e-c983-47ed-9773-c95b0d2b9949 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:38.414349 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5362be2e-c983-47ed-9773-c95b0d2b9949 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:38.422112 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5362be2e-c983-47ed-9773-c95b0d2b9949 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.153680 Nov 16 19:15:38.422657 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 537/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:38 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:38.457010 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-8b7c54f4-28b4-4e58-acab-2a42e2af0a0a req-176e4c57-4d1d-4c81-9702-f493ce5814f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe776799-5aba-4894-a1c3-35f96f710982", "name": "network-vif-plugged", "status": "completed", "tag": "b8d27769-cb89-48e8-829c-d3246940d9f3"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:15:38.458609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:15:38.458609 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:15:38.465707 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-8b7c54f4-28b4-4e58-acab-2a42e2af0a0a req-176e4c57-4d1d-4c81-9702-f493ce5814f6 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:38.466145 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-8b7c54f4-28b4-4e58-acab-2a42e2af0a0a req-176e4c57-4d1d-4c81-9702-f493ce5814f6 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:38.477142 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-8b7c54f4-28b4-4e58-acab-2a42e2af0a0a req-176e4c57-4d1d-4c81-9702-f493ce5814f6 service nova] Creating event network-vif-plugged:b8d27769-cb89-48e8-829c-d3246940d9f3 for instance fe776799-5aba-4894-a1c3-35f96f710982 on hv-cinder-66710 Nov 16 19:15:38.481967 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-8b7c54f4-28b4-4e58-acab-2a42e2af0a0a req-176e4c57-4d1d-4c81-9702-f493ce5814f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028460 Nov 16 19:15:38.482538 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 515/1052] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:15:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:15:39.438525 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f3fb8d57-f338-4a59-bbb8-46c23fc361db tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:39.439126 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f3fb8d57-f338-4a59-bbb8-46c23fc361db tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:39.445341 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3fb8d57-f338-4a59-bbb8-46c23fc361db tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:39.445820 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3fb8d57-f338-4a59-bbb8-46c23fc361db tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:39.446601 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3fb8d57-f338-4a59-bbb8-46c23fc361db tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:39.447034 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3fb8d57-f338-4a59-bbb8-46c23fc361db tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:39.573854 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f3fb8d57-f338-4a59-bbb8-46c23fc361db tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:39.581539 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f3fb8d57-f338-4a59-bbb8-46c23fc361db tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1264 microversion: 2.1 time: 0.146709 Nov 16 19:15:39.582114 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 538/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:39 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:40.599275 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-629acfad-ef10-4b3c-af3f-0e30185ccfcb tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:40.599969 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-629acfad-ef10-4b3c-af3f-0e30185ccfcb tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:40.606074 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-629acfad-ef10-4b3c-af3f-0e30185ccfcb tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:40.606522 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-629acfad-ef10-4b3c-af3f-0e30185ccfcb tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:40.607295 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-629acfad-ef10-4b3c-af3f-0e30185ccfcb tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:40.607724 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-629acfad-ef10-4b3c-af3f-0e30185ccfcb tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:40.738772 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-629acfad-ef10-4b3c-af3f-0e30185ccfcb tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:40.746071 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-629acfad-ef10-4b3c-af3f-0e30185ccfcb tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1452 microversion: 2.1 time: 0.151184 Nov 16 19:15:40.746647 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 516/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:40 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:40.763685 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1c54e16b-f7de-4bf1-8974-3a06f1e0dc48 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:15:40.764297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1c54e16b-f7de-4bf1-8974-3a06f1e0dc48 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:15:40.771189 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1c54e16b-f7de-4bf1-8974-3a06f1e0dc48 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:40.771641 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1c54e16b-f7de-4bf1-8974-3a06f1e0dc48 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:40.772417 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1c54e16b-f7de-4bf1-8974-3a06f1e0dc48 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:40.772880 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1c54e16b-f7de-4bf1-8974-3a06f1e0dc48 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:40.903102 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1c54e16b-f7de-4bf1-8974-3a06f1e0dc48 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:15:40.910456 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1c54e16b-f7de-4bf1-8974-3a06f1e0dc48 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1452 microversion: 2.1 time: 0.150399 Nov 16 19:15:40.911014 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 539/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:15:40 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:15:42.701002 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-718a7680-ad30-4261-9742-130b196b8bf7 req-88b7ad50-18a3-451f-8148-c15d7821cf96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe776799-5aba-4894-a1c3-35f96f710982", "tag": "b8d27769-cb89-48e8-829c-d3246940d9f3"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:15:42.702613 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:15:42.702613 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:15:42.709485 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-718a7680-ad30-4261-9742-130b196b8bf7 req-88b7ad50-18a3-451f-8148-c15d7821cf96 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:15:42.709956 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-718a7680-ad30-4261-9742-130b196b8bf7 req-88b7ad50-18a3-451f-8148-c15d7821cf96 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:15:42.723237 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-718a7680-ad30-4261-9742-130b196b8bf7 req-88b7ad50-18a3-451f-8148-c15d7821cf96 service nova] Creating event network-changed:b8d27769-cb89-48e8-829c-d3246940d9f3 for instance fe776799-5aba-4894-a1c3-35f96f710982 on hv-cinder-66710 Nov 16 19:15:42.728487 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-718a7680-ad30-4261-9742-130b196b8bf7 req-88b7ad50-18a3-451f-8148-c15d7821cf96 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031065 Nov 16 19:15:42.729064 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 517/1056] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:16:51.447060 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-56a71aa1-365c-425e-ba32-eb6cf05cf852 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:16:51.447621 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-56a71aa1-365c-425e-ba32-eb6cf05cf852 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:16:51.454628 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56a71aa1-365c-425e-ba32-eb6cf05cf852 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:51.455165 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56a71aa1-365c-425e-ba32-eb6cf05cf852 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:51.456536 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56a71aa1-365c-425e-ba32-eb6cf05cf852 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:51.457037 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56a71aa1-365c-425e-ba32-eb6cf05cf852 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:51.482587 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-56a71aa1-365c-425e-ba32-eb6cf05cf852 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:16:51.550939 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-4c2597bf-e27e-490b-b4dd-e97e2b7ecd3b req-7b5f07d0-5bd1-40c2-884f-9da211f41b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811", "tag": "09ee89b4-ca67-46d8-a2ca-e497e063a615"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:16:51.552374 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:16:51.552374 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:16:51.559993 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-4c2597bf-e27e-490b-b4dd-e97e2b7ecd3b req-7b5f07d0-5bd1-40c2-884f-9da211f41b9d service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:51.560625 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-4c2597bf-e27e-490b-b4dd-e97e2b7ecd3b req-7b5f07d0-5bd1-40c2-884f-9da211f41b9d service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:51.567981 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-56a71aa1-365c-425e-ba32-eb6cf05cf852 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 204 len: 0 microversion: 2.1 time: 0.125083 Nov 16 19:16:51.568984 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 540/1057] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:16:51 2021] DELETE /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:16:51.573746 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-4c2597bf-e27e-490b-b4dd-e97e2b7ecd3b req-7b5f07d0-5bd1-40c2-884f-9da211f41b9d service nova] Creating event network-changed:09ee89b4-ca67-46d8-a2ca-e497e063a615 for instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 on hv-cinder-66710 Nov 16 19:16:51.579487 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9d0a0bde-0ee5-455c-affc-99925662db69 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:16:51.579856 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-4c2597bf-e27e-490b-b4dd-e97e2b7ecd3b req-7b5f07d0-5bd1-40c2-884f-9da211f41b9d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134025 Nov 16 19:16:51.580203 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9d0a0bde-0ee5-455c-affc-99925662db69 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:16:51.581864 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 518/1058] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:16:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:16:51.587723 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d0a0bde-0ee5-455c-affc-99925662db69 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:51.588181 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d0a0bde-0ee5-455c-affc-99925662db69 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:51.588979 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d0a0bde-0ee5-455c-affc-99925662db69 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:51.589418 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d0a0bde-0ee5-455c-affc-99925662db69 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:51.792951 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9d0a0bde-0ee5-455c-affc-99925662db69 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:16:51.801064 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9d0a0bde-0ee5-455c-affc-99925662db69 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1569 microversion: 2.1 time: 0.226687 Nov 16 19:16:51.801781 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 541/1059] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:16:51 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:16:52.819376 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6cc77e75-c19c-4c80-931e-fbbbfedacf0a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:16:52.820066 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6cc77e75-c19c-4c80-931e-fbbbfedacf0a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:16:52.826245 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6cc77e75-c19c-4c80-931e-fbbbfedacf0a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:52.826688 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6cc77e75-c19c-4c80-931e-fbbbfedacf0a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:52.827459 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6cc77e75-c19c-4c80-931e-fbbbfedacf0a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:52.827893 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6cc77e75-c19c-4c80-931e-fbbbfedacf0a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:53.011706 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6cc77e75-c19c-4c80-931e-fbbbfedacf0a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:16:53.019541 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6cc77e75-c19c-4c80-931e-fbbbfedacf0a tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1451 microversion: 2.1 time: 0.205334 Nov 16 19:16:53.020095 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 519/1060] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:16:52 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1451 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:16:53.928098 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-480152a7-0b5b-424a-8f13-b9192058d779 req-810c445a-73ba-413e-8120-c8acf763d7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811", "name": "network-vif-deleted", "tag": "09ee89b4-ca67-46d8-a2ca-e497e063a615"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:16:53.929644 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:16:53.929644 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:16:53.939062 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-480152a7-0b5b-424a-8f13-b9192058d779 req-810c445a-73ba-413e-8120-c8acf763d7d6 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:53.939591 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-480152a7-0b5b-424a-8f13-b9192058d779 req-810c445a-73ba-413e-8120-c8acf763d7d6 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:53.953858 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-480152a7-0b5b-424a-8f13-b9192058d779 req-810c445a-73ba-413e-8120-c8acf763d7d6 service nova] Creating event network-vif-deleted:09ee89b4-ca67-46d8-a2ca-e497e063a615 for instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 on hv-cinder-66710 Nov 16 19:16:53.958543 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-480152a7-0b5b-424a-8f13-b9192058d779 req-810c445a-73ba-413e-8120-c8acf763d7d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035028 Nov 16 19:16:53.959125 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 542/1061] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:16:54.037692 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-6edbffff-dc82-4704-bb18-3884fe18a75d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:16:54.038301 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-6edbffff-dc82-4704-bb18-3884fe18a75d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:16:54.044761 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6edbffff-dc82-4704-bb18-3884fe18a75d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:54.045216 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6edbffff-dc82-4704-bb18-3884fe18a75d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:54.046037 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6edbffff-dc82-4704-bb18-3884fe18a75d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:54.046470 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-6edbffff-dc82-4704-bb18-3884fe18a75d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:54.105828 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-6edbffff-dc82-4704-bb18-3884fe18a75d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba65da1f1ab442a9d2516d3a8b18e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64eef6e0383c42f39e24aff3690b58fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:16:54.113466 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-6edbffff-dc82-4704-bb18-3884fe18a75d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 200 len: 1219 microversion: 2.1 time: 0.079985 Nov 16 19:16:54.113986 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 520/1062] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:16:54 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:16:55.130782 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:16:55.131465 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [instance: 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:16:55.138210 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:55.138651 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:55.139419 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:16:55.139848 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:16:55.153387 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] HTTP exception thrown: Instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 could not be found. Nov 16 19:16:55.153989 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Returning 404 to user: Instance 7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:16:55.154796 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5719905b-7555-472a-b170-84b38a16d221 tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811" status: 404 len: 111 microversion: 2.1 time: 0.028131 Nov 16 19:16:55.155316 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 543/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:16:55 2021] GET /compute/v2.1/servers/7ce7712c-e0f7-47f4-b5ea-ebc0d76a1811 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:16:55.317337 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-c7ddb33e-fa19-4b2a-b5de-5b1f2b7cbe3d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] Calling method '.version_select at 0x7ffa56bd7e50>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:16:55.321827 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c7ddb33e-fa19-4b2a-b5de-5b1f2b7cbe3d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [4e274754-252c-46b1-9cb3-da03dd644245] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 16 19:16:56.339015 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO oslo.messaging._drivers.impl_rabbit [None req-c7ddb33e-fa19-4b2a-b5de-5b1f2b7cbe3d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] [4e274754-252c-46b1-9cb3-da03dd644245] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 41452. Nov 16 19:16:56.357955 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-c7ddb33e-fa19-4b2a-b5de-5b1f2b7cbe3d tempest-TestShelveInstance-1758833649 tempest-TestShelveInstance-1758833649-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-510977476" status: 202 len: 0 microversion: 2.1 time: 1.044810 Nov 16 19:16:56.358529 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 521/1064] 10.222.0.46 () {58 vars in 1250 bytes} [Tue Nov 16 19:16:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-510977476 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:17:25.662470 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c99a99c9-37c8-4431-9185-7c2f220710f1 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:25.663098 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c99a99c9-37c8-4431-9185-7c2f220710f1 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:25.668539 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-277bdd4c-2489-426d-afbd-da595a87084a req-9e6dad71-32bc-4281-be88-f456d71d41d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe776799-5aba-4894-a1c3-35f96f710982", "tag": "b8d27769-cb89-48e8-829c-d3246940d9f3"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:17:25.670244 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:17:25.670244 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:17:25.679446 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c99a99c9-37c8-4431-9185-7c2f220710f1 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:25.680233 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c99a99c9-37c8-4431-9185-7c2f220710f1 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:25.681428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c99a99c9-37c8-4431-9185-7c2f220710f1 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:25.681600 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-277bdd4c-2489-426d-afbd-da595a87084a req-9e6dad71-32bc-4281-be88-f456d71d41d5 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:25.682203 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c99a99c9-37c8-4431-9185-7c2f220710f1 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:25.682325 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-277bdd4c-2489-426d-afbd-da595a87084a req-9e6dad71-32bc-4281-be88-f456d71d41d5 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:25.702285 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-277bdd4c-2489-426d-afbd-da595a87084a req-9e6dad71-32bc-4281-be88-f456d71d41d5 service nova] Creating event network-changed:b8d27769-cb89-48e8-829c-d3246940d9f3 for instance fe776799-5aba-4894-a1c3-35f96f710982 on hv-cinder-66710 Nov 16 19:17:25.711536 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-277bdd4c-2489-426d-afbd-da595a87084a req-9e6dad71-32bc-4281-be88-f456d71d41d5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054536 Nov 16 19:17:25.712785 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 522/1065] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:17:25.729381 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c99a99c9-37c8-4431-9185-7c2f220710f1 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:17:25.830343 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c99a99c9-37c8-4431-9185-7c2f220710f1 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 204 len: 0 microversion: 2.1 time: 0.176956 Nov 16 19:17:25.831935 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 544/1066] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:17:25 2021] DELETE /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:17:25.846055 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-084cb3fd-f3b3-4b2c-94ec-ad3e11d567bf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:25.847140 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-084cb3fd-f3b3-4b2c-94ec-ad3e11d567bf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:25.856955 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-084cb3fd-f3b3-4b2c-94ec-ad3e11d567bf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:25.857526 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-084cb3fd-f3b3-4b2c-94ec-ad3e11d567bf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:25.858734 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-084cb3fd-f3b3-4b2c-94ec-ad3e11d567bf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:25.859381 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-084cb3fd-f3b3-4b2c-94ec-ad3e11d567bf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:26.166487 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-084cb3fd-f3b3-4b2c-94ec-ad3e11d567bf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:17:26.175959 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-084cb3fd-f3b3-4b2c-94ec-ad3e11d567bf tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1576 microversion: 2.1 time: 0.336678 Nov 16 19:17:26.176540 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 523/1067] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:17:25 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1576 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:17:27.203734 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d893e4f7-6531-4287-a3a8-fe175d4104fd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:27.204430 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d893e4f7-6531-4287-a3a8-fe175d4104fd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:27.211350 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d893e4f7-6531-4287-a3a8-fe175d4104fd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:27.211792 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d893e4f7-6531-4287-a3a8-fe175d4104fd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:27.212568 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d893e4f7-6531-4287-a3a8-fe175d4104fd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:27.213000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d893e4f7-6531-4287-a3a8-fe175d4104fd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:27.647302 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d893e4f7-6531-4287-a3a8-fe175d4104fd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:17:27.661512 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d893e4f7-6531-4287-a3a8-fe175d4104fd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 200 len: 1458 microversion: 2.1 time: 0.461396 Nov 16 19:17:27.662463 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 545/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:17:27 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 1458 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:17:27.906973 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [req-be060042-4b44-4f43-a170-b911e33e4d36 req-cdb5fb72-8eff-44de-870f-5880cbcc44c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe776799-5aba-4894-a1c3-35f96f710982", "name": "network-vif-deleted", "tag": "b8d27769-cb89-48e8-829c-d3246940d9f3"}]} {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:17:27.908472 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:17:27.908472 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: warnings.warn(msg) Nov 16 19:17:27.915989 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-be060042-4b44-4f43-a170-b911e33e4d36 req-cdb5fb72-8eff-44de-870f-5880cbcc44c4 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:27.916436 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [req-be060042-4b44-4f43-a170-b911e33e4d36 req-cdb5fb72-8eff-44de-870f-5880cbcc44c4 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:27.928210 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.compute.server_external_events [req-be060042-4b44-4f43-a170-b911e33e4d36 req-cdb5fb72-8eff-44de-870f-5880cbcc44c4 service nova] Creating event network-vif-deleted:b8d27769-cb89-48e8-829c-d3246940d9f3 for instance fe776799-5aba-4894-a1c3-35f96f710982 on hv-cinder-66710 Nov 16 19:17:27.934347 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [req-be060042-4b44-4f43-a170-b911e33e4d36 req-cdb5fb72-8eff-44de-870f-5880cbcc44c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030921 Nov 16 19:17:27.934964 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 524/1069] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:17:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:17:28.686306 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:28.686888 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: fe776799-5aba-4894-a1c3-35f96f710982] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:28.692890 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:28.693328 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:28.694571 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:28.694571 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:28.707744 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] HTTP exception thrown: Instance fe776799-5aba-4894-a1c3-35f96f710982 could not be found. Nov 16 19:17:28.708332 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Returning 404 to user: Instance fe776799-5aba-4894-a1c3-35f96f710982 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:17:28.709146 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9464848c-d680-4551-a018-e5d6928fa858 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982" status: 404 len: 111 microversion: 2.1 time: 0.026517 Nov 16 19:17:28.709704 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 546/1070] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:17:28 2021] GET /compute/v2.1/servers/fe776799-5aba-4894-a1c3-35f96f710982 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:17:31.836558 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-521549d7-78b2-4f99-ae03-abec2f599f9f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:31.837302 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-521549d7-78b2-4f99-ae03-abec2f599f9f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:31.837965 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-4e3788b2-db56-46c9-a839-a6b75d3dc305 req-7ecb6721-e49a-42cb-a856-1239fbfa9409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2654762b-4f00-4de9-b1af-e2be569d09c5", "tag": "a30d891d-e171-4453-a208-576a4e39415d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:17:31.839742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:17:31.839742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:17:31.844122 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-521549d7-78b2-4f99-ae03-abec2f599f9f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:31.845023 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-521549d7-78b2-4f99-ae03-abec2f599f9f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:31.845951 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-521549d7-78b2-4f99-ae03-abec2f599f9f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:31.846490 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-521549d7-78b2-4f99-ae03-abec2f599f9f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:31.847298 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-4e3788b2-db56-46c9-a839-a6b75d3dc305 req-7ecb6721-e49a-42cb-a856-1239fbfa9409 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:31.847740 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-4e3788b2-db56-46c9-a839-a6b75d3dc305 req-7ecb6721-e49a-42cb-a856-1239fbfa9409 service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:31.859858 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-4e3788b2-db56-46c9-a839-a6b75d3dc305 req-7ecb6721-e49a-42cb-a856-1239fbfa9409 service nova] Creating event network-changed:a30d891d-e171-4453-a208-576a4e39415d for instance 2654762b-4f00-4de9-b1af-e2be569d09c5 on hv-cinder-66710 Nov 16 19:17:31.864963 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-4e3788b2-db56-46c9-a839-a6b75d3dc305 req-7ecb6721-e49a-42cb-a856-1239fbfa9409 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030980 Nov 16 19:17:31.865535 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 547/1071] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:17:31.875704 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-521549d7-78b2-4f99-ae03-abec2f599f9f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Going to try to terminate instance {{(pid=116169) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 19:17:31.988999 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-521549d7-78b2-4f99-ae03-abec2f599f9f tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 204 len: 0 microversion: 2.1 time: 0.157417 Nov 16 19:17:31.989914 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 525/1072] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:17:31 2021] DELETE /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 19:17:31.998705 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-999ef02e-bbc6-45b8-afcd-a7d73ae821e8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:31.999929 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-999ef02e-bbc6-45b8-afcd-a7d73ae821e8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:32.007563 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-999ef02e-bbc6-45b8-afcd-a7d73ae821e8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:32.008023 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-999ef02e-bbc6-45b8-afcd-a7d73ae821e8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:32.008819 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-999ef02e-bbc6-45b8-afcd-a7d73ae821e8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:32.009428 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-999ef02e-bbc6-45b8-afcd-a7d73ae821e8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:32.154055 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-999ef02e-bbc6-45b8-afcd-a7d73ae821e8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:17:32.163794 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-999ef02e-bbc6-45b8-afcd-a7d73ae821e8 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1576 microversion: 2.1 time: 0.169223 Nov 16 19:17:32.164449 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 548/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:17:31 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:17:33.182509 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-174b9610-4319-4ca5-8589-631dc07caa66 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:33.183194 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-174b9610-4319-4ca5-8589-631dc07caa66 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:33.189349 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-174b9610-4319-4ca5-8589-631dc07caa66 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:33.189955 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-174b9610-4319-4ca5-8589-631dc07caa66 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:33.190950 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-174b9610-4319-4ca5-8589-631dc07caa66 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:33.191382 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-174b9610-4319-4ca5-8589-631dc07caa66 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:33.336353 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-174b9610-4319-4ca5-8589-631dc07caa66 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:17:33.343817 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-174b9610-4319-4ca5-8589-631dc07caa66 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1457 microversion: 2.1 time: 0.165940 Nov 16 19:17:33.344390 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 526/1074] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:17:33 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1457 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:17:34.085297 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-2b623c41-58a1-40a8-b9ea-459849c301af req-69809e3f-3185-4c5b-8671-fd3b5bb6d6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2654762b-4f00-4de9-b1af-e2be569d09c5", "name": "network-vif-deleted", "tag": "a30d891d-e171-4453-a208-576a4e39415d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 19:17:34.089000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 19:17:34.089000 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 19:17:34.098280 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-2b623c41-58a1-40a8-b9ea-459849c301af req-69809e3f-3185-4c5b-8671-fd3b5bb6d6fb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:34.098803 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-2b623c41-58a1-40a8-b9ea-459849c301af req-69809e3f-3185-4c5b-8671-fd3b5bb6d6fb service nova] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:34.114742 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-2b623c41-58a1-40a8-b9ea-459849c301af req-69809e3f-3185-4c5b-8671-fd3b5bb6d6fb service nova] Creating event network-vif-deleted:a30d891d-e171-4453-a208-576a4e39415d for instance 2654762b-4f00-4de9-b1af-e2be569d09c5 on hv-cinder-66710 Nov 16 19:17:34.120154 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-2b623c41-58a1-40a8-b9ea-459849c301af req-69809e3f-3185-4c5b-8671-fd3b5bb6d6fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041855 Nov 16 19:17:34.120844 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 549/1075] 10.222.0.46 () {64 vars in 1317 bytes} [Tue Nov 16 19:17:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 19:17:34.361806 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:34.363256 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:34.371748 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:34.372590 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:34.373686 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:34.374371 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:34.413177 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:34.413657 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:34.414507 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.objects.instance [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lazy-loading 'fault' on Instance uuid 2654762b-4f00-4de9-b1af-e2be569d09c5 {{(pid=116169) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 19:17:34.456290 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.policy [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99e8dcf6fbda47a0b243239f62720c4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaa0849f50740c491e5f247362c3b10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116169) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 19:17:34.465308 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-f139206b-e813-4849-aeac-363e183dd696 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 200 len: 1229 microversion: 2.1 time: 0.107631 Nov 16 19:17:34.466185 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 527/1076] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:17:34 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 19:17:35.483642 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:35.484327 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 2654762b-4f00-4de9-b1af-e2be569d09c5] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:35.490411 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:35.490861 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:35.491636 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:35.492571 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:35.505595 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] HTTP exception thrown: Instance 2654762b-4f00-4de9-b1af-e2be569d09c5 could not be found. Nov 16 19:17:35.506188 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Returning 404 to user: Instance 2654762b-4f00-4de9-b1af-e2be569d09c5 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:17:35.507020 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-94330939-ad64-4ecb-85c7-ea485b7af091 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5" status: 404 len: 111 microversion: 2.1 time: 0.027969 Nov 16 19:17:35.507558 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 550/1077] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:17:35 2021] GET /compute/v2.1/servers/2654762b-4f00-4de9-b1af-e2be569d09c5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:17:35.971821 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:35.972412 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.compute.api [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116169) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:35.979464 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:35.979906 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:35.980689 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:35.981137 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG oslo_concurrency.lockutils [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116169) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:35.995422 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.wsgi [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] HTTP exception thrown: Instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 could not be found. Nov 16 19:17:35.996007 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Returning 404 to user: Instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 could not be found. {{(pid=116169) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:17:35.996823 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-0bb15762-1156-4eba-9fe4-e111fc4c81ad tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 404 len: 111 microversion: 2.1 time: 0.029531 Nov 16 19:17:35.997357 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 528/1078] 10.222.0.46 () {58 vars in 1238 bytes} [Tue Nov 16 19:17:35 2021] DELETE /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:17:36.005489 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:36.006116 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] [instance: 3cebd59d-87d0-453a-a5de-0af744f39fa4] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 19:17:36.012255 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:36.012693 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:36.013469 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 19:17:36.013926 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Lock "2ad1d2f2-15e4-42bc-bf20-68092f43efab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 19:17:36.029221 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] HTTP exception thrown: Instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 could not be found. Nov 16 19:17:36.029834 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Returning 404 to user: Instance 3cebd59d-87d0-453a-a5de-0af744f39fa4 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 19:17:36.030669 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f0b60c8c-de8e-49fe-a7c9-b82ed4d8cabd tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4" status: 404 len: 111 microversion: 2.1 time: 0.028999 Nov 16 19:17:36.031200 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 551/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Tue Nov 16 19:17:36 2021] GET /compute/v2.1/servers/3cebd59d-87d0-453a-a5de-0af744f39fa4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 19:17:37.331983 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: DEBUG nova.api.openstack.wsgi [None req-9a6ea63c-199b-4b99-91d8-8ef14f60c680 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] Calling method '.version_select at 0x7ffa56bacdc0>' {{(pid=116169) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 19:17:37.353838 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO nova.api.openstack.requestlog [None req-9a6ea63c-199b-4b99-91d8-8ef14f60c680 tempest-TestVolumeBootPattern-2096910270 tempest-TestVolumeBootPattern-2096910270-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-376292854" status: 202 len: 0 microversion: 2.1 time: 0.024539 Nov 16 19:17:37.354434 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: [pid: 116169|app: 0|req: 529/1080] 10.222.0.46 () {58 vars in 1259 bytes} [Tue Nov 16 19:17:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-376292854 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 19:18:02.758613 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:18:02.759320 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: Tue Nov 16 19:18:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:18:06.548236 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:18:06.548836 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: Tue Nov 16 19:18:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:18:16.395768 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:18:16.396357 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: Tue Nov 16 19:18:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:19:59.913442 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:19:59.914126 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: Tue Nov 16 19:19:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:20:07.626590 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:20:07.627161 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: Tue Nov 16 19:20:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:20:54.113454 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:20:54.114115 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: Tue Nov 16 19:20:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:21:22.776806 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:21:22.777577 dv-cinder-667108-35-iscsi devstack@n-api.service[116169]: Tue Nov 16 19:21:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:21:26.566160 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:21:26.566715 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: Tue Nov 16 19:21:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 19:21:36.414062 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 19:21:36.414711 dv-cinder-667108-35-iscsi devstack@n-api.service[116168]: Tue Nov 16 19:21:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!